Why I tried this
I always picked the cover line of a card news post by gut feeling. So for two weeks I kept the topic the same, wrote two versions of the cover line, and posted both. A non-developer can set it up in about ten minutes.
Steps
1. Pick one topic. Mine was 「how to organize weekly work notes」.
2. Ask the bot for two versions.
Topic: how to organize weekly work notes
Write the cover line in two versions.
A contains a number, B is a question.
Keep each under 20 characters and leave everything else identical.
3. Make a tracking sheet. Four columns are enough: date, type (A/B), saves, comments.
4. Post them in turns. To reduce weekday effects, week one had A on Mon/Wed/Fri and B on Tue/Thu/Sat. In week two I flipped the order.
Results
Across 7 matched pairs, the numeric line got more saves in 5 of them. Comments went the other way: the question line led in 6 pairs. In short, numbers made people want to come back later, and questions made people want to talk.
Takeaways
• Decide the goal first and the choice gets easy. Numbers for saves, questions for conversation.
• The sample is small, so treat this as a reference, not an answer.
• When asking the bot to summarize results, add one line: 「Don't state a firm conclusion, and include the number of pairs.」 It keeps the summary from overreaching.
Next up, I plan to compare cover lines of 10 versus 20 characters.