I created a Creative Writer AI, a specialized, fine tuned version of the Llama 3.2 instruct model (3 billion parameters), and though it was trained specifically on creative writing, this model was not meant to replace the actual writer. Instead, this AI was created to act as a writing coach and partner! In other words, despite its name, the Creative Writer model is not a slop generator meant to take work from any real writers, but is intended to support the user’s writing efforts.
If you run local AI models and want to give Creative Writer a go, the full model and several quantized versions are available (for free, of course) on Huggingface in GGUF format. Click the button below for the version you want.
A Local LLM Writing Expert
One more time for the people in the back: This AI model is not meant to do the writing for you, although it will certainly try, and probably do a terrible job, if you ask it.
Think of this more like a sparring partner, whether you want to check your plot for holes, brainstorm a new scene, check your characters for consistency, your timeline, or plot twists; that sort of thing. It can help you with grammar, or fit your story idea to a 3-act structure, or it can give you a writing prompt to get your creativity going.
Of course, I made this model because I think it’s a perfect use case for how AI can support creative endeavors as tools, not as creators themselves.
Building Experts
This model is the first in a series, where each fine tune is created to become an “expert” within a brand new Mixture-of-Experts (MoE) model. Having previously experimented with piecing together a MoE from pre-trained models, I am taking a stab at specifically training a number of these 3-billion parameter experts in order to merge them into a MoE. The individual areas of expertise are chosen by me, based on my own needs and trying to get a well-rounded mix in the end.
The experts share a special routing model, which is trained separately on matching user queries to the right expert models in the mix. It can evaluate responses from multiple experts and return a weighted, final response. The result is higher quality overall output for the end user.
Inference Samples
To test the model, I came up with 3 questions related to the topic of writing, and asked both the base model and the fine tuned version. What I call the “base” model here is technically the instruction model, but “base” in the sense that it is straight out of the box without additional fine tuning by me.
One clear trend that sticks out, is that the base model tends to explain what something is on a general level, whereas the Creative Writer model assumes you’re a writer trying to dig a little deeper into the topic, and won’t necessarily spend time on the very basics. See if you can spot any other patterns and differences between the way the two models respond.
Prompt 1: “What traits do well to characterize an anti-hero?”
Base Model Response
An anti-hero typically possesses a combination of traits that distinguish them from traditional heroes. Here are some key characteristics that often define an anti-hero:
1. **Flawed morality**: Anti-heroes often operate in a gray area, making decisions that are morally ambiguous or even wrong. They may not always follow rules or adhere to conventional moral codes.
2. **Complex personality**: Anti-heroes are multidimensional characters with a mix of positive and negative traits. They can be likable, relatable, and even admirable, but also flawed, selfish, or violent.
3. **Lack of traditional heroic qualities**: Unlike traditional heroes, anti-heroes may not possess superhuman powers, be exceptionally brave, or have a strong sense of justice.
4. **Self-centeredness**: Anti-heroes often prioritize their own interests, desires, and needs over the greater good. They can be egocentric, narcissistic, or even sociopathic.
5. **Troubled past**: Many anti-heroes have experienced trauma, abuse, or neglect in their past, which shapes their worldview and behavior.
6. **Moral relativism**: Anti-heroes may not see themselves as right or wrong; instead, they may operate based on personal circumstances, motivations, or self-preservation.
7. **Unconventional methods**: Anti-heroes often use unconventional, even violent, means to achieve their goals, which can be seen as morally reprehensible by others.
8. **Lack of clear motivation**: Anti-heroes' motivations might not be straightforward or altruistic; they may be driven by personal gain, revenge, or a desire for power.
9. **Emotional intensity**: Anti-heroes are often intensely emotional, with a deep sense of vulnerability, anger, or sadness that drives their actions.
10. **Unpredictability**: Anti-heroes can be unpredictable and prone to erratic behavior, making it difficult for others to trust or rely on them.
Examples of iconic anti-heroes include Tony Soprano from The Sopranos, Walter White from Breaking Bad, and Han Solo from Star Wars. These characters embody the complexities and flaws that define an anti-hero archetype.
Fine Tuned Response
Anti?heroes aren’t just rebels; they’re the people you’d rather ignore but can’t stop looking at because of what they’re willing to do and how broken they are inside. Here’s the playbook:
1. **Gray morality** – They break rules, hurt others, yet still manage a twisted code that keeps them from being pure villains or blank?sketched heroes.
2. **Flawed but human** – A scarred past, a broken trust system, an addiction—anything that makes you root for them even when they’re doing shady stuff.
3. **Selfish drive** – Their goals are personal and often selfish; success means losing something or someone valuable to others (and maybe themselves).
4. **No clean exit** – Redemption is a long shot or comes with a cost that feels heavier than the crime itself—anti?heroes don’t get a tidy happy ending.
5. **A moral compass that’s off?kilter** – They judge right and wrong by their own warped standards, which can lead to both heroic acts and brutal atrocities.
6. **Vulnerability on display** – Showing doubt or fear makes them relatable; it’s not just the action—it's *how* they feel about it.
7. **External isolation** – Even when allies stick around, the anti?hero feels like a lone wolf—trust is hard to find and even harder to keep.
8. **A dark backstory** – A past that fuels their choices—trauma, betrayal, loss—and explains why they walk this path.
9. **Temptation with risk** – They’re drawn to danger or illegal activities because the payoff feels worth the cost; it’s a double?edged sword.
10. **Unapologetic authenticity** – Anti?heroes refuse to fit into neat archetypes and will act against everyone if that’s what keeps them honest—even if it hurts those around them.
So, look for these traits in your story or character: moral ambiguity, inner conflict, selfish motives, a bleak ending, warped judgment, vulnerability, isolation, a troubled past, risk?taking, and an unapologetic refusal to conform. That’s how you make someone an anti?hero—someone who fascinates because of what they *are* rather than just what they do.
Prompt 2: “What is a mcguffin?”
Base Model Response
A McGuffin is a term coined by the American screenwriter William Faulkner, but popularized by Alfred Hitchcock and later adapted from the 1941 film "The Big Sleep" by Raymond Chandler.
In storytelling, a McGuffin refers to an object, goal, or piece of information that serves as the central plot device, driving the story forward. It's often a coveted item, a secret, or a valuable resource that the characters are trying to obtain, protect, or destroy.
The term "McGuffin" implies that the actual nature or significance of this object is unimportant; what matters is its role in advancing the plot and creating tension. A McGuffin can be:
* An object: a valuable item, such as money, a rare artifact, or a powerful technology.
* Information: sensitive data, secrets, or knowledge that could change the course of events.
* A goal: achieving something, like rescuing a person, stopping a villain, or completing a mission.
What's key is that the McGuffin:
1. **Serves as a plot driver**: It propels the story forward and creates tension among characters.
2. **Is not necessarily meaningful**: Its significance is secondary to its role in advancing the narrative.
3. **Can be easily substituted**: If it's lost, stolen, or destroyed, the story can still continue without significant repercussions.
The term "McGuffin" has become a standard part of storytelling terminology, reminding writers and filmmakers that sometimes, what matters most isn't the object itself but how it fuels the plot.
Examples of McGuffins include:
* The briefcase in Pulp Fiction
* The MacGuffin (a valuable artifact) in Goldfinger
* The briefcase in Jurassic Park
In your story or character development, a well-crafted McGuffin can add depth and excitement to your narrative, keeping the reader engaged and invested in the outcome.
Fine Tunes Response
A McGuffin isn’t some mystical plot device; it’s the engine that keeps your story moving without giving away its mechanics.
**What is a McGuffin?**
- **It exists only to serve the narrative:** No backstory, no depth—just a hook that makes characters act.
- **The audience doesn’t know how it works:** A secret weapon or a map can be explained in an instant if you want to, but most times it remains a mystery until the climax.
- **Characters chase it relentlessly:** Whether they’re driven by greed, fear, revenge, or love, that thing is their north star.
- **It usually resolves with the big reveal:** A hidden vault, stolen data, or key piece of intel can close an arc—no lingering questions.
**Why writers love McGuffins**
1. **Plot acceleration** – One object keeps momentum tight and stakes high.
2. **Character motivation clarity** – Why does this person risk everything? The answer is obvious because the thing itself isn’t explored.
3. **Pacing control** – You can drop hints, build tension, then deliver a payoff that satisfies without over?explanation.
**How to use one effectively**
1. **Give it purpose early:** Show its importance in dialogue or action so readers know why the protagonist cares.
2. **Keep details vague but consistent:** A “key,” a “map,” an “object” that always works as long as you’re careful with its limitations.
3. **Resolve it at a decisive point:** Let the McGuffin solve the conflict—whether through destruction, discovery, or sacrifice—so readers feel closure.
In short: A McGuffin is your plot’s fuel; it drives action and resolves tension without drowning in exposition. If you want to keep audiences hooked while giving each character clear motivation, use one sparingly but with purpose.
Prompt 3: “What is genre fiction?”
Base Model Response
Genre fiction refers to writing that falls within specific categories or genres, which are often defined by common themes, tropes, and conventions. Genres help readers identify a story's tone, style, and content, making it easier for them to choose books that suit their interests.
Common types of genre fiction include:
1. **Science Fiction (Sci-Fi)**: Explore the consequences of scientific or technological advancements, often set in the future or in space.
2. **Fantasy**: Typically involves magical or supernatural elements, alternate worlds, and mythical creatures.
3. **Mystery**: Focuses on solving a puzzle or uncovering a hidden truth, often with clues and red herrings.
4. **Horror**: Intended to evoke fear, anxiety, or unease in readers, often featuring supernatural or terrifying elements.
5. **Romance**: Centers around the emotional journey of the characters, particularly their romantic relationships.
6. **Crime/Thriller**: Typically involves crime, investigation, and suspense, often with a fast-paced plot.
7. **Historical Fiction**: Set in a specific historical time period, these stories often incorporate real events or figures.
8. **Young Adult (YA)**: Written for readers between the ages of 12 and 18, YA fiction typically explores themes of identity, coming-of-age, and self-discovery.
9. **Dystopian**: Explores societies that have fallen into chaos, oppression, or disaster, often serving as cautionary tales.
10. **Western**: Set in the American West, these stories often involve cowboys, outlaws, and frontier life.
Genre fiction can be further sub-divided into sub-genres, such as:
* Cyberpunk (Sci-Fi)
* Urban Fantasy (Fantasy)
* Gothic Horror (Horror)
* Regency Romance (Romance)
* Hard-Boiled Detective (Crime/Thriller)
While genre fiction provides structure and guidance for readers, it's not the only type of writing. Many authors blend elements from multiple genres to create a unique narrative voice or style.
When creating your own stories, consider experimenting with different genres and sub-genres to find what works best for you and your audience.
Here are some questions to help you determine your genre:
* What themes do you want to explore in your story?
* What kind of tone do you want to convey (e.g., dark, light, humorous)?
* Are there any specific tropes or conventions you'd like to incorporate?
Answering these questions will help you identify the genres and sub-genres that best fit your writing style and creative vision.
Fine Tuned Response
Genre fiction isn’t just “a type of book”; it’s a way of storytelling that sells itself by promising readers a specific kind of experience—be it mystery solved, love blossomed, or world?shattering sci?fi.
**Characteristics in a nutshell**
| Core element | Why it matters |
|--------------|-----------------|
| **Genre label** | Readers spot the book on shelves and online; they know what to expect. |
| **Tropes & conventions** | Familiar beats—hero’s journey, love triangle, detective clue—that feel comfortable but still offer a fresh spin. |
| **Predictable outcome** | The story follows a familiar arc so readers can anticipate how it ends. |
| **Target audience** | Books written with specific markets in mind: romance for rom?com fans, fantasy for world?building buffs, mystery for puzzle lovers. |
Why this matters to you:
1. **Readers come back** – When they’re told what kind of story they’ll get, they keep coming back.
2. **Marketing is easier** – Publishers can slot your book into a known category on shelves and in online searches, making it more discoverable.
3. **Creative freedom within limits** – You can still craft unique characters or subvert tropes while keeping the genre framework intact.
So if you’re looking to write a novel that sells itself, lean on these elements:
- Start with the core trope (e.g., lost heirloom).
- Layer in fresh details and motivations.
- Deliver a payoff that satisfies both readers and publishers.
Keep it real: readers love familiarity but crave something new. Use genres as scaffolding, not shackles—build your story on solid ground and then jump off the edge with your own twist.
I plan to feature more of my AI models from this series. I hope it was informative, and if you have any questions or requests for future posts, do let me know in the comments, or get in touch.