Comparison of Open-Source and Proprietary Models in Media Sector Rankings
open-source
| Source: Mastodon | Original article
Open-source image editing models trail proprietary ones. FLUX.2 ranks 16th, 80 ELO points behind Riverflow 2.0.
The media model leaderboard has sparked interest in the comparison between open-source and proprietary models, particularly in image editing. As of the latest update, the best open-source model, FLUX.2, ranks 16th, 80 ELO points behind the top proprietary model, Riverflow 2.0. This ranking is based on blind human preference, providing a more accurate assessment of model performance.
The open-source community has made significant strides in recent years, with 63% of models in the dataset being open-source. While proprietary models still lead in average score and top model performance, the gap is closing rapidly. The cost advantage of open-source models is substantial, with an average cost of $0.83 per million tokens compared to $6.03 for proprietary models.
As the landscape continues to evolve, it will be interesting to watch how open-source models narrow the performance gap with their proprietary counterparts. With the leaderboard updated regularly, users can track the progress of both open-source and proprietary models, making informed decisions about which models to use for their specific needs.
Sources
Back to AIPULSEN