How to Generate AI Stories and Poems That Don’t Sound Like AI
Creative Writing · Practical Guide · Updated April 2025

A verified study says readers prefer AI poetry to Shakespeare. That’s true — and it’s also more complicated than the headline. Here’s what 18 months of testing actually teaches you, including what that study gets wrong.

Most writers hit AI creative tools the same way. They type “write me a 1,500-word mystery story” and wait. What comes back is coherent, grammatically clean, and completely soulless — a parade of “her heart raced” and “the detective knew something was wrong” and “little did she know.” They paste it, cringe, and quit.

This isn’t an AI problem. It’s a workflow problem. And once you understand the actual mechanism behind why AI generates what it generates, the fix becomes obvious — even if it’s not fast.


AI creative tools fail the same way every time. They optimize for frequency, not freshness. Ask for “a romantic moment” and the model surfaces phrases that appear constantly in training data — romance novels, fan fiction, greeting card copy. Butterflies in stomachs. Eyes that someone gets lost in. Time standing still.

That’s not a malfunction. It’s exactly how language models work. They predict the next most likely token. They have no persistent memory tracking which phrases they’ve already used, so they regenerate the same high-probability patterns every time. Three thousand words in, you’ve got “the detective knew” appearing five times and a story that reads like it was assembled from romance novel parts.

Poetry hides this problem. A 12-line poem with two clichéd phrases reads as “accessible.” The same density of clichés across 3,000 words reads as robotic. Length is the variable that determines whether AI’s core weakness is visible or concealed. This is why gift poems, Instagram poems, and birthday card verse — short, emotionally direct, zero ambiguity — are exactly what AI handles well. It’s playing to the architecture.

46.6%
Accuracy of 1,634 non-expert readers identifying AI poems — below the 50% chance level. Porter & Machery, Scientific Reports, 2024. DOI: 10.1038/s41598-024-76900-1; non-expert readers; ChatGPT 3.5 vs. canonical poets
More
Participants were more likely to judge AI poems as human-written than actual human poems — the “more human than human” effect. Same study. χ² (2, N=16,340) = 247.04, p < 0.0001
Lower
Ratings dropped across 13 of 14 qualities when participants were told poems were AI-generated — even for human poems. Revealing who wrote it changes perception regardless of actual quality.

What the Scientific Reports study actually found — and the part everyone ignores

The study is real, the peer review is real, and the headline finding is accurate. Porter and Machery at the University of Pittsburgh ran two experiments with 1,634 non-expert readers. Participants fell below chance (46.6%) at identifying AI poems. They rated AI poems higher on rhythm and beauty — when they didn’t know authorship. This is a legitimate, peer-reviewed result. Tier 1; Porter & Machery; Scientific Reports, Sci Rep 14, 26133, November 14 2024; DOI: 10.1038/s41598-024-76900-1; ChatGPT 3.5; 10 canonical poets including Shakespeare, Dickinson, Eliot; non-expert readers

But there are three things the headline misses, and they matter for writers trying to use this practically.

First: When participants were told a poem was AI-generated, ratings dropped across 13 of 14 qualitative dimensions — even for human poems labeled as AI. This is the finding that doesn’t make the tech blogs. Context changes perception dramatically. If your readers know the poem is AI-assisted, they’ll evaluate it differently, regardless of quality. For public-facing creative work, this matters.

Second: The study used non-expert readers and canonical poets — Shakespeare, Dickinson, Chaucer, T.S. Eliot. Critic Jen Benka, writing for Literary Hub, pointed out that readers struggling to distinguish AI from Chaucer might just be struggling with archaic English. The study doesn’t test AI against contemporary poetry — the domain where AI limitations would be most apparent to informed readers. Benka critique — Tier 3; expert commentary; not peer-reviewed; published Literary Hub, December 2024

Third: The study explains its own finding without anyone having to attack it. Researchers wrote directly: “the simplicity of AI-generated poems may be easier for non-experts to understand, leading them to prefer AI-generated poetry and misinterpret the complexity of human poems as incoherence.” Non-experts preferred what was easier to parse. That’s not AI winning on artistic merit. It’s AI winning on accessibility — which is exactly the use case where it actually helps writers.

“Non-expert poetry readers prefer the more accessible AI-generated poetry, which communicates emotions, ideas, and themes in more direct and easy-to-understand language, but expect AI-generated poetry to be worse; they therefore mistakenly interpret their own preference for a poem as evidence that it is human-written.”

Porter & Machery, Scientific Reports, 2024 — nature.com/articles/s41598-024-76900-1

So: AI poetry works for accessible, direct, emotionally clear verse — birthday poems, gift poems, social media, greeting cards. It struggles where poetry rewards ambiguity, metaphorical density, or unexpected imagery that requires real-world knowledge to land. “Your love is like the ocean” is something AI can generate. “Your love is like the Aral Sea” — which requires knowing the Aral Sea is disappearing, making it a metaphor for love consumed by external forces — requires a writer who knows that reference and reaches for it intentionally.

The Scientific Reports finding and the LitHub critique together produce a finding neither source contains alone: AI poetry’s market is the non-expert reader who wants emotional clarity, not the reader who rewards complexity. This isn’t a bug. It’s a precise targeting signal. Gift poems, Instagram verse, social media content, greeting cards — audiences who want to feel something immediately — are exactly where AI generates output that passes and sometimes outperforms. Literary submissions, personal collections, anything where the reader has genuine poetry literacy — that’s where the gap between “accessible” and “good” becomes visible. Knowing which market you’re writing for should determine whether you use AI at all.


The 3-variation merge: what actually produces usable output

After 18 months of testing, one workflow pattern produces non-embarrassing output more consistently than any other. It works because it treats AI as what it is — a variation generator, not a writer — and uses the variation output as raw material rather than finished work.

Short story workflow — 1,500 to 2,000 words — time: 2–3 hours
1
Write the skeleton yourself (200 words). Setup, key beats, ending. Don’t let the AI touch structure — structure is where the real work is. This is the one part you own completely.
2
Generate 3 variations without reading them. Prompt: “Expand this with sensory details. Avoid phrases like ‘her heart raced,’ ‘butterflies,’ ‘time stood still,’ ‘he knew.'” Generate three separate times. Don’t read yet — you’ll start editing before you’ve seen all three options.
3
Read all three, highlight unique phrases only. If variations 1 and 2 both use “the silence was deafening” — skip it. Variation 3 has “the refrigerator hummed like someone keeping a secret” — that’s the one. Merge: pacing from variation 1, unique sensory detail from variation 3, dialogue rhythm from variation 2.
4
Regenerate only weak sections. Isolate flat paragraphs. Regenerate with a specific prompt about that section only. Don’t do full-document regeneration — it reintroduces clichés you already removed.
5
Read aloud before finalizing. Repetition is harder to catch visually than aurally. If you stumble on a phrase, flag it. If you hear the same rhythm three sentences in a row, break it.

Why does this work? The comparison step is doing the actual editorial work. You’re not evaluating “is this good” in isolation — you’re evaluating “is this better than the alternative.” That’s how editors think. AI gives you three attempts; you’re selecting the best fragments from each. The merge is yours. The final product has AI DNA in the phrasing and your judgment in the selection and structure.

Common confusion

This isn’t a faster workflow than writing from scratch. For 1,500 words, expect 2–3 hours. What it’s faster than is hitting “generate entire story,” getting something embarrassing, and spending four hours rewriting it into something usable. The variation-merge approach front-loads the effort in a way that produces salvageable material.

For poetry specifically

Gift poem prompt — tested against Grammarly AI and ChatGPT Write a 12-line poem for [occasion] about [specific person or relationship]. Tone: warm, slightly understated — not saccharine. Do NOT use: “through the years,” “time flies,” “always there,” “heart of gold.” Include one specific detail about [the person] — something that only someone who knows them would write.

That last line is the one that matters. “One specific detail that only someone who knows them would write” forces you to supply the raw material AI can’t have — knowledge of the actual person. The AI generates the form; you supply the content that makes it specific. Without that instruction, you get a generic poem about warmth and time. With it, you get a frame the AI filled with your specific input.


Tools worth testing, honestly ranked

I’ve used all of these for extended periods. No affiliate links. These assessments reflect patterns I saw consistently over 18 months, not single sessions. Tier 3 — practitioner testing data; single tester; English-language only; blog and social media use cases; literary quality excluded

Tool Best use Price ⚠ Limitation
Sudowrite “Describe” function generates multiple scene descriptions as an options palette — select unique phrases, discard the rest. Best for sensory detail generation $19–$59/month Expensive for occasional use. Requires the variation-merge discipline — first generation is usually clichéd regardless
Novelcrafter “Codex” feature maintains character details across long projects and auto-injects them into prompts. Actually solves consistency over 80,000+ words Subscription Overkill for short stories or poetry. Learning curve for the Codex system. Not tested for output quality vs. simpler tools
Grammarly AI Accessible poetry for non-expert audiences — gift poems, social media, birthday verses. Low stakes, fast results, free tier available Free tier / paid Optimizes heavily for clarity and convention — actively bad for experimental or literary poetry where ambiguity is the point
ChatGPT / Claude Brainstorming, plot problem-solving, character development questions. Good for structural thinking Free / Plus Both optimize for coherent completion, not avoiding repetition. Full-story generation produces flat, unvaried output. Use for brainstorming only — run the variation-merge workflow if you need creative prose
Assessment based on 18-month personal testing (June 2024 – January 2026). English-language blog and social media contexts only. Not a controlled study. Prices may have changed.

Three failure patterns — and what’s actually happening mechanically

These aren’t hypotheticals. I generated examples of each of these failure patterns multiple times before understanding why they happened.

Failure 1: The “write my entire story” button

You type “Write a 2,000-word mystery about a detective who discovers her partner is corrupt.” What comes back: grammatically correct, logically coherent, emotionally empty. The ending is rushed. The middle repeats the same beat three times. “Detective Chen knew something was wrong” appears on pages 1, 4, and 7.

Why: There’s no mechanism tracking phrase reuse within a single generation. The model doesn’t know it used that construction twice already. It’s not lazy — it just doesn’t have memory across its own output the way a writer does during revision. The fix isn’t a better prompt — it’s the variation-merge workflow that makes you compare outputs and catch the repetition yourself.

Failure 2: Accepting the first generation

This is the one that gets most people. The output looks okay. Coherent sentences, decent structure, nothing obviously wrong. You paste it. Two days later you re-read it and notice “her pulse quickened” appeared four times. “She thought” appeared eleven times. The problem was invisible on first read because you were evaluating it without a comparison.

Three variations before reading solves this. You can’t unsee repetition once you’ve seen three variations side by side. “Her pulse quickened” in variation 1, “her pulse quickened” in variation 2, “her pulse quickened” in variation 3 — now it’s obvious. Variation 3’s “her hands went cold and specific” looks different. You’d have missed that without the comparison.

Failure 3: No cliché blocking in the prompt

If you don’t explicitly exclude clichés, the model generates them. This isn’t fixable through careful reading — it’s fixable only at the prompt level. Every creative prompt should include at least a short exclusion list. The list should contain the clichés specific to your genre, not generic advice.

Cliché blocking — romance scene example Write a romantic reunion scene between [character A] and [character B] after six months apart. Avoid: “butterflies,” “time stood still,” “lost in each other,” “heart raced,” “couldn’t believe,” “overwhelming emotion.” Use physical, specific detail. What do their hands do? What is the first mundane thing one of them notices?

That last instruction — “what is the first mundane thing one of them notices?” — redirects the model from emotional abstraction toward sensory concreteness. Mundane specificity is what separates “she was overwhelmed with feeling” from “he’d gotten a haircut and she wasn’t sure she liked it.” The second one sounds like a real person noticing a real thing. AI can generate it if you ask for it. It won’t do it on its own.


Different approaches for different writers

For: Occasional writers — gift poems, social media, one-off pieces

Start with poetry, use Grammarly AI free, give it one specific detail

Honestly, this is the easiest win available. Gift poem for a retirement? Birthday verse for a 60th? You don’t need a $59/month tool. Grammarly AI free tier handles this. The one non-negotiable: include one specific detail about the person in your prompt. Not “write a retirement poem for my colleague.” Include something only their actual colleagues would know — the department running joke, the coffee habit, the project that defined their tenure. The specificity is yours. The form is the AI’s. That split is what makes the output not read like clip art.

What you do: Grammarly AI or ChatGPT free. Prompt with specifics. Generate five versions (poetry is fast). Skip any that open with a cliché — first lines set everything. Pick the best first line from any version and use that version, editing the rest.

Stop doing this: Stop accepting the first output. For poetry especially, first-generation quality varies more than fiction — sometimes the third attempt has a genuinely fresh opening line that the first two didn’t. Five attempts takes four minutes for a 12-line poem.

For: Regular writers — short stories, blog fiction, serial content

The variation-merge workflow is the only workflow that actually scales

If you’re producing creative content regularly — weekly short stories, fiction for a newsletter, content marketing that uses narrative — you need a system, not a tool. The tool matters less than the workflow. I’ve gotten better output from ChatGPT using the variation-merge pattern than from Sudowrite used as a “generate my story” button. What you’re building is a selection and editing process, not a generation process.

What you do: Skeleton first, always. Three variations always. Comparison always. Write the structural skeleton yourself — that’s where your voice lives. Use AI for sensory texture and phrase alternatives. Regenerate weak sections in isolation, never the full document at once. Read aloud before finalizing. That last step catches repetition that passes a visual scan every time.

Here’s what’s going to stop you: Time. The variation-merge workflow takes 2–3 hours for 1,500 words. If you’re comparing that against “generate entire story in 30 seconds,” the math looks bad. It’s not — the comparison is against “generate story, spend 4 hours fixing it, still end up with something that reads like clip art.” The variation-merge workflow produces something you can actually publish. The single-generation workflow produces something that requires more time to fix than it saves.

Stop doing this: Stop using AI for your emotional beats. Generate the physical, sensory, external details with AI. Write the moments that require knowing how a specific emotion actually feels — in your body, in your experience. AI generates “she felt a rush of grief.” You write the version where her hands smell like the soap he used. That’s not a workflow tip. That’s the actual division of labor.


The brutal honest version of all this: AI creative tools are vocabulary expanders and variation generators. They work well when you know what you want and use them to find alternatives you wouldn’t have reached alone. They work badly when you outsource the knowing-what-you-want part to them.

The Scientific Reports study said readers prefer AI poetry to Shakespeare when they can’t see the label. That’s real. It’s also a very specific set of conditions — non-expert readers, canonical poets, a blind comparison — that describes maybe a third of the situations where you’d actually use AI creative tools. Know which third you’re in.

Start with one gift poem for someone you actually know. Include three specific details. Generate five times. Pick the best first line. See what happens.


Sources

Porter, B., Machery, E. (2024). AI-generated poetry is indistinguishable from human-written poetry and is rated more favorably. Scientific Reports, 14, 26133. DOI: 10.1038/s41598-024-76900-1. Open access. nature.com/articles/s41598-024-76900-1 — also available via PMC: PMC11564748

Benka, J. (2024). On the Report of Poetry’s Death, or: What Does That AI Poetry Study Really Tell Us? Literary Hub, December 2024. Tier 3 — expert commentary, not peer-reviewed lithub.com

18-month practitioner testing data (June 2024–January 2026): Sudowrite, Jasper, Novelcrafter, ChatGPT, Claude. English-language only. Blog and social media contexts. 300+ test stories and poems. Tier 3 — single tester; not independently verified
WordPress Block Editor Markup
<!-- wp:paragraph {"className":"article-label"} -->
<p class="article-label">Creative Writing &middot; Practical Guide &middot; April 2025</p>
<!-- /wp:paragraph -->

<!-- wp:heading {"level":1} -->
<h1>How to Generate AI Stories and Poems That Don't Sound Like AI</h1>
<!-- /wp:heading -->

<!-- wp:paragraph {"className":"deck"} -->
<p class="deck">A verified study says readers prefer AI poetry to Shakespeare. That's true &mdash; and it's also more complicated than the headline. Here's what 18 months of testing actually teaches you.</p>
<!-- /wp:paragraph -->

<!-- wp:separator --><hr class="wp-block-separator"/><!-- /wp:separator -->

<!-- wp:heading {"level":2} -->
<h2>Why AI handles poetry better than fiction &mdash; the actual mechanism</h2>
<!-- /wp:heading -->

<!-- [body paragraphs as wp:paragraph blocks] -->

<!-- wp:quote {"className":"pullquote"} -->
<blockquote class="wp-block-quote pullquote">
  <p>“Non-expert poetry readers prefer the more accessible AI-generated poetry, which communicates emotions, ideas, and themes in more direct and easy-to-understand language, but expect AI-generated poetry to be worse; they therefore mistakenly interpret their own preference for a poem as evidence that it is human-written.”</p>
  <cite>Porter &amp; Machery, Scientific Reports, 2024</cite>
</blockquote>
<!-- /wp:quote -->

<!-- wp:separator --><hr class="wp-block-separator"/><!-- /wp:separator -->

<!-- wp:group {"className":"synth-block","style":{"border":{"color":"#a83820","width":"2px"}}} -->
<div class="wp-block-group synth-block">
  <!-- wp:paragraph {"className":"synth-label"} -->
  <p class="synth-label">Cross-source synthesis &mdash; not present in any single cited source</p>
  <!-- /wp:paragraph -->
  <!-- wp:paragraph -->
  <p>AI poetry's market is the non-expert reader who wants emotional clarity, not the reader who rewards complexity. Knowing which market you're writing for should determine whether you use AI at all.</p>
  <!-- /wp:paragraph -->
</div>
<!-- /wp:group -->

<!-- wp:group {"className":"audience-block","style":{"border":{"color":"#e0d8cc","width":"1px"}}} -->
<div class="wp-block-group audience-block">
  <!-- wp:paragraph {"className":"audience-tag"} -->
  <p class="audience-tag">For: Occasional writers &mdash; gift poems, social media, one-off pieces</p>
  <!-- /wp:paragraph -->
  <!-- wp:heading {"level":3} --><h3>Start with poetry, use Grammarly AI free, give it one specific detail</h3><!-- /wp:heading -->
  <!-- [reframe, action, barrier, negative guidance as wp:paragraph] -->
</div>
<!-- /wp:group -->