AI models shun Python, favor PHP after 1,200 queries of 12 models – The JetBrains Blog
| Source: Mastodon | Original article
A JetBrains blog survey of 12 AI models, queried 1,200 times, shows a clear preference for PHP over Python.
JetBrains’ AI research blog has published a new analysis titled “AI models hate Python and love PHP: we asked 12 of them 1,200 times.” The post reports that a dozen popular code‑generation models were queried repeatedly – a total of 1,200 prompts – to gauge their preferences for different programming languages. The results, according to the blog, show a clear bias: the models consistently performed worse on Python‑related tasks while showing a marked preference for PHP.
The finding matters because AI‑driven code assistants are increasingly embedded in development workflows across the Nordics and beyond. If the underlying models favor certain languages, developers may receive lower‑quality suggestions for the languages they actually use, potentially skewing productivity and influencing language adoption decisions. The bias also raises questions about the training data and evaluation metrics that shape these models, highlighting a gap that tool vendors and model providers need to address.
Going forward, observers will be watching whether JetBrains or the model owners respond with retraining efforts, updated prompts, or new benchmarking standards. The broader AI community may also launch independent studies to confirm or refute the results, and developers can expect more transparent reporting on language‑specific performance as AI coding assistants become mainstream.
Sources
Back to AIPULSEN