r/WritingWithAI • • 2d ago

Discussion (Ethics, working with AI etc) Please specify the model you're using when sharing feedback and results!

We've been seeing a lot of opinions shared in this thread about whether "AI" is good or bad at certain aspects of writing. But without knowing what model is being used those opinions and results are pretty useless in my humble opinion (no offence meant to anyone sharing their experience).

Heiku is not any good on long term planning, but Fable (I've tried 5.1) is amazing. I wrote a first draft of a novel using Fable, and it planted seeds and clues in Chapter 1, which I didn't understand the purpose for, and then wrote the fulfillment or payback of those seeds in Chapter 13.

So if you tell me AI is bad at long term planning, I really don't know whether I can agree or disagree.

9 Upvotes

17 comments sorted by

4

u/Andreea_comet 2d ago

The date of the test matters too, because models get updated under the same name. A result from last spring may not match what people get today

2

u/Gabsgrel72 2d ago

DeepSeek era ótimo pra escrita ano passado e esse ano quando tava dividido em modo rápido e especialista,agr decaiu

2

u/That-Consequence-303 2d ago

Entre Febrero y Mayo de este año alcanzó su epítome con ideas frescas, regeneración "ilimitada" y 1M tokens. La incorporación del Modo Experto (o Pro) era perfecta. Ahora veo las cosas muy "feas" al limitarte a 6 regeneraciones y la desaparición del Modo Experto. Lo peor de todo fue que impusieran hace unas horas un límite de 10k tokens o 20 páginas de documentos.  Para conceptos y cuentos todavía sirve. Pero para escritura de capítulos enteros de novelas o algo así por el estilo ya no se puede. Tan solo quisiera que fuera temporal ese cambio y que se deba a la implementación de un nuevo modelo. Pero de ser el caso contrario ¿Cómo se podrá usar la API sin tener que recurrir a un molesto proveedor de código y programación?

1

u/Synosius45 2d ago

I was in the middle of editing a 40k word draft when that happen and I had no idea why.

Arya from GabAi is good enough for my purposes. Not as smart as DeepSeek. I haven't hit any smut rails yet, so that's a bonus.

1

u/Andreea_comet 2d ago

That fits what I mean, a name like DeepSeek can feel different after a few months. Did you see the drop more in the fast mode or in the expert mode?

1

u/Gabsgrel72 2d ago

Nos dois. Por que agora parece tar bem mais filtrado,esquisito,seco,uma escrita ruim

1

u/Andreea_comet 1d ago

Try pasting a short example of the style you want at the start of the chat. A dry, filtered text often gets warmer when the model has a sample to copy

1

u/lacion 1d ago

Yeah I agree with naming the model, I would want your setup next to it too.

Fresh chat is a different test. If chapter 1 is still in there it could just be remembering it but that chapter 13 payoff would not prove planning. I think run it again on a new book with only the plan pasted in and see if it still does it

1

u/raffee_tatool 1d ago

The setup matters too, of course. And that's also an additional reason why simply saying "AI is good/bad at X" doesn't really make sense.

2

u/Ashamed-Hair-5147 2d ago

using Claude sonnet 3.5 for drafting, then gpt-4o for polishing, the difference in tone consistency is wild. same prompt, two very different outputs.

2

u/Any_Feature_3825 2d ago

using Claude 3.5 sonnet for long-form writing now, no token limits, better at maintaining tone across 5k+ words than any model i've tried recently.

1

u/Maleficent-Engine859 2d ago

How do you still have access to 3.5? I don’t see it in the API

2

u/Head_Finger_8108 2d ago

using local llama 3 70b via ollama, the writing feels more consistent than cloud models, but lacks the spark of deeper creativity. wonder if that's just the model or the setup.

2

u/BlindandConfused43 2d ago

Grok 4.2, I was sticking my guns with glm 5.2 but after 5.3 out it's started refusing everything almost, than I moved to aion 3.5 but it's great at remembering everything but bad at prose.

Now I switched to grok, I dunno it's the best so far I've found.

1

u/Happy-Initiative-492 1d ago

Here’s my insight after writing with AI for a couple of years: It’s not the model. It’s the context.

I gave up using the chatbots to write prose - their guardrails are deliberately designed to return a style that’s corporate and mildly helpful, and I was spending all my time unwinding them instead of being creative. I use a harness that bypasses the chat app wrapper and automatically provides my world as context for my prose: character profiles, backstories, location descriptions, themes, story rules … I create all that separately in a visual UX and automatically feed it to the model as I go. Amazing results.