Difference languages make in a prompt: Stéphane Mallarme's Apparition poem: an experiment in French & English poetic prompting
By CaylaCatz
Comments (17)
CaylaCatz
Very cool! I would love to see what happens with your results. I've tried one word tests too with a single seed on a different platform and even with just one word in different languages, there are differences. I have no clue why. I agree being able to translate yourself instead of relying on other people's translations or even computer or AI translations would be wonderful. I only speak one language tho although my mom spoke 3 and English was her third language. A USA teacher told her I would fail kindergarten unless she only spoke English to me so she stopped and I lost the other 2 languages. At the time, USA kindergarten & elementary teachers did not understand language development in children. Monolingual as in only English was being pushed very hard back then. I did not pick up the other language again in college either tho I started the class. I was so dumb. It bothered me that the professor did not sound right as I was used to my mom and her friends accents. I did not learn until I was much older that adult-learners don't gain native pronunciation although they will be close and that it is harder to learn a language later. Something to do with how our brain or bodies develop up to around 6 or 7. Too bad I didn't know the stuff I learned later when I was a college student. I might have been more patient and learned more.
base451121
@CaylaCatz Yes, dearest Cayla, I too have noticed that models react differently to texts in different languages, even if it's just a single word. This makes me think that the trainers also adapt their methods, which to me means that the SD4.5 I own (German tool) was probably trained differently than the same SD4.5 (American tool). But that seems far too complicated. Or is it due to the fact that online translators (e.g., Google) aren't perfect enough yet, and that's why there are discrepancies? The languages someone learns in their family are definitely incredibly important and helpful, provided, however, that these languages are used as often as possible over the years, because otherwise, they will be lost over time. My English is so patchy that I don't even attempt to write complete texts. There's an Italian saying that would perfectly describe me: "Io parlo l'inglese come un toro spagnolo" (I speak English like a Spanish bull). However, as an Italian, I've had to grapple with the German language since I was 18 because I've lived in Germany ever since. These days, I think and write (this) in German because I have few opportunities to use my native language. Nevertheless, I still speak perfect Italian, even if I often miss a word or two. I'll be taking the test we discussed soon and will gladly let you know how it goes.
CaylaCatz
The whole language and AI thing is very interesting. I think maybe as people write their prompts in different languages, their prompts are also training the models -- maybe in how to understand prompts. Or maybe the AI makes assumption. I noticed in some models, if I did "obake onna" along with the english vs "ghost woman", I got a more anime-ish result. I don't know if "obake onna" shows up more in anime art and maybe "ghost woman" shows up in other types of art descriptions. I'm looking forward to your experiment. It'll be fun to see the results
base451121
@CaylaCatz, I think that to truly understand how models react to a language, we should definitely master the language itself and do the translations ourselves. Even then, it's difficult to create the same meaning in the sentences, especially since poetry often uses words that sound different in everyday speech. And when AI is used for the translation, it quickly becomes a mountain out of a molehill. But Cayla's approach is very interesting. I'll soon try translating Italian poetry into German and creating photos with different models. I'm excited! 🤔😊😉 This translation is provided by Google.😉👌👋
CaylaCatz
It's interesting. Even a one-word prompt like "steampunk" in some models even with the same seed can perform differently. I don't speak Japanese but I know a few words. I've noticed even if my prompt is mostly English, if I throw in a couple of Japanese words like obake (ghost), the art style will change to be a little more anime or ukiyo-e in style without me prompting for it.
DavidP
Thanks for sharing. Lovely images. Interesting to see how the different models intrepret the poem, and the comparison between the French and English in each case. As I recall it was a conversation we had that originally inspired me to try the Latin poem-only prompt. Now I am re-inspired to go again in BP https://budgetpixel.com/p/12372 https://budgetpixel.com/p/12375 https://budgetpixel.com/p/12376
CaylaCatz
I'm glad I reinspired you. The final one you created with the latin poem without the words showing was amazing! Thank you also for looking at my blog post, for clapping and commenting.
EternaSky
I should try to translate my prompts to french and try too
King
I actually have never tried the same prompt in different langs.
CaylaCatz
that would be cool. Some of them respond quite a bit differently to different languages. About half don't show seeds any more; mostly the newest ones don't show seeds