{"id":75956,"date":"2024-10-03T08:12:52","date_gmt":"2024-10-03T15:12:52","guid":{"rendered":"https:\/\/blog.mozilla.org\/?p=75956"},"modified":"2024-10-03T08:12:55","modified_gmt":"2024-10-03T15:12:55","slug":"lumigator","status":"publish","type":"post","link":"https:\/\/blog.mozilla.org\/en\/mozilla\/ai\/lumigator\/","title":{"rendered":"Introducing Lumigator"},"content":{"rendered":"\n<p>In today\u2019s fast-moving AI landscape, choosing the right large language model (LLM) for your project can feel like navigating a maze. With hundreds of models, each offering different capabilities, the process can be overwhelming. That\u2019s why <a href=\"http:\/\/mozilla.ai\/?ref=blog.mozilla.ai\" target=\"_blank\" rel=\"noreferrer noopener\">Mozilla.ai<\/a> is developing <em>Lumigator, <\/em>a product designed to help developers confidently select the best LLM for their specific project. It&#8217;s like having a trusty compass for your AI journey.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>The problem (and why we\u2019re tackling it)<\/strong><\/h2>\n\n\n\n<p>As more organizations turn to AI for solutions, they face the challenge of selecting the best model from an ever-growing list of options. The AI landscape is evolving rapidly, with <a href=\"https:\/\/hai.stanford.edu\/research\/ai-index-report?ref=blog.mozilla.ai\">twice as many new models released in 2023 compared to the previous year<\/a>. Yet, in spite of the wealth of metrics available, there\u2019s still no standard way to compare these models.&nbsp;<\/p>\n\n\n\n<p><a href=\"https:\/\/aiindex.stanford.edu\/wp-content\/uploads\/2024\/05\/HAI_AI-Index-Report-2024.pdf?ref=blog.mozilla.ai\">The <em>2024 AI Index Report<\/em><\/a> highlighted that AI evaluation tools aren\u2019t (yet) keeping up with the pace of development, making it harder for developers and businesses to make informed choices. Without a clear single method for comparing models, many teams end up using suboptimal solutions, or just choosing models based on hype, slowing down product progress and innovation.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>Our mission (and how we\u2019re getting started)<\/strong><\/h2>\n\n\n\n<p>With Lumigator MVP, <a href=\"https:\/\/www.mozilla.ai\/?ref=blog.mozilla.ai\">Mozilla.ai<\/a> aims to make model selection transparent, efficient, and empowering. Lumigator provides a framework for comparing LLMs, using task-specific metrics to evaluate how well a model fits your project\u2019s needs. With Lumigator, we want to ensure that you\u2019re not just picking a model\u2014you\u2019re picking the <em>right<\/em> model for your use case.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>Our vision for the future<\/strong><\/h2>\n\n\n\n<p>In the future, Lumigator will grow beyond evaluation into a full-blown open-source product for ethical and transparent AI development and fill in gaps in the AI development tooling landscape in the industry. We want to create a space where developers can trust the tools they use, knowing they\u2019re building solutions that align with their values.<\/p>\n\n\n\n<p>Our MVP is just the start. While we\u2019re focused on model selection now, we\u2019re building towards something much bigger. Lumigator\u2019s ultimate goal is to become the go-to open-source platform for developers who want to make sure they\u2019re using AI in a way that is transparent, ethical, and aligned with their values. With the input of the community, we\u2019ll continue to expand beyond evaluation and text summarization into all aspects of AI development. Together, we\u2019ll shape Lumigator into a tool that you can trust.<\/p>\n\n\n\n<p>With Lumigator, we want to democratize AI. What do we mean by this? We want to make advanced technologies available to both developers and to organizations of all sizes. Our mission is to enable people to build solutions that leverage AI to align with their goals and values\u2014whether it\u2019s fostering transparency, driving innovation, or creating a more inclusive future for AI.<\/p>\n\n\n\n<p><a href=\"https:\/\/blog.mozilla.ai\/introducing-lumigator-2\/\" target=\"_blank\" rel=\"noreferrer noopener\">Read the whole text and subscribe to the Lumigator newsletter.<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>In today\u2019s fast-moving AI landscape, choosing the right large language model (LLM) for your project can feel like navigating a maze. With hundreds of models, each offering different capabilities, the process can be overwhelming. That\u2019s why Mozilla.ai is developing Lumigator, a product designed to help developers confidently select the best LLM for their specific project. [&hellip;]<\/p>\n","protected":false},"author":1889,"featured_media":75958,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[464197],"tags":[317823],"coauthors":[464255],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v22.5 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Introducing Lumigator<\/title>\n<meta name=\"description\" content=\"Lumigator is designed to help developers confidently select the best LLM for their specific project.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/blog.mozilla.org\/en\/mozilla\/ai\/lumigator\/\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/blog.mozilla.org\/en\/mozilla\/ai\/lumigator\/\",\"url\":\"https:\/\/blog.mozilla.org\/en\/mozilla\/ai\/lumigator\/\",\"name\":\"Introducing Lumigator\",\"isPartOf\":{\"@id\":\"https:\/\/blog.mozilla.org\/en\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/blog.mozilla.org\/en\/mozilla\/ai\/lumigator\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/blog.mozilla.org\/en\/mozilla\/ai\/lumigator\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/blog.mozilla.org\/wp-content\/blogs.dir\/278\/files\/2024\/10\/photo-1528904125624-f485d66786ef.jpg\",\"datePublished\":\"2024-10-03T15:12:52+00:00\",\"dateModified\":\"2024-10-03T15:12:55+00:00\",\"author\":{\"@id\":\"https:\/\/blog.mozilla.org\/en\/#\/schema\/person\/ff2a2684ab8dcbe5372151857748455d\"},\"description\":\"Lumigator is designed to help developers confidently select the best LLM for their specific project.\",\"breadcrumb\":{\"@id\":\"https:\/\/blog.mozilla.org\/en\/mozilla\/ai\/lumigator\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/blog.mozilla.org\/en\/mozilla\/ai\/lumigator\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/blog.mozilla.org\/en\/mozilla\/ai\/lumigator\/#primaryimage\",\"url\":\"https:\/\/blog.mozilla.org\/wp-content\/blogs.dir\/278\/files\/2024\/10\/photo-1528904125624-f485d66786ef.jpg\",\"contentUrl\":\"https:\/\/blog.mozilla.org\/wp-content\/blogs.dir\/278\/files\/2024\/10\/photo-1528904125624-f485d66786ef.jpg\",\"width\":2000,\"height\":1333,\"caption\":\"Credit: Martin Adams \/ Unsplash\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/blog.mozilla.org\/en\/mozilla\/ai\/lumigator\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/blog.mozilla.org\/en\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Introducing Lumigator\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/blog.mozilla.org\/en\/#website\",\"url\":\"https:\/\/blog.mozilla.org\/en\/\",\"name\":\"The Mozilla Blog\",\"description\":\"News and Updates about Mozilla\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/blog.mozilla.org\/en\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/blog.mozilla.org\/en\/#\/schema\/person\/ff2a2684ab8dcbe5372151857748455d\",\"name\":\"Kristina Bravo\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/blog.mozilla.org\/en\/#\/schema\/person\/image\/cd320165a9224f3c60c912bf4086a89f\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/22fa545a3c48bc13cc1d84d5e09ffbff?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/22fa545a3c48bc13cc1d84d5e09ffbff?s=96&d=mm&r=g\",\"caption\":\"Kristina Bravo\"},\"url\":\"https:\/\/blog.mozilla.org\/en\/author\/kbravo\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Introducing Lumigator","description":"Lumigator is designed to help developers confidently select the best LLM for their specific project.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/blog.mozilla.org\/en\/mozilla\/ai\/lumigator\/","schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/blog.mozilla.org\/en\/mozilla\/ai\/lumigator\/","url":"https:\/\/blog.mozilla.org\/en\/mozilla\/ai\/lumigator\/","name":"Introducing Lumigator","isPartOf":{"@id":"https:\/\/blog.mozilla.org\/en\/#website"},"primaryImageOfPage":{"@id":"https:\/\/blog.mozilla.org\/en\/mozilla\/ai\/lumigator\/#primaryimage"},"image":{"@id":"https:\/\/blog.mozilla.org\/en\/mozilla\/ai\/lumigator\/#primaryimage"},"thumbnailUrl":"https:\/\/blog.mozilla.org\/wp-content\/blogs.dir\/278\/files\/2024\/10\/photo-1528904125624-f485d66786ef.jpg","datePublished":"2024-10-03T15:12:52+00:00","dateModified":"2024-10-03T15:12:55+00:00","author":{"@id":"https:\/\/blog.mozilla.org\/en\/#\/schema\/person\/ff2a2684ab8dcbe5372151857748455d"},"description":"Lumigator is designed to help developers confidently select the best LLM for their specific project.","breadcrumb":{"@id":"https:\/\/blog.mozilla.org\/en\/mozilla\/ai\/lumigator\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/blog.mozilla.org\/en\/mozilla\/ai\/lumigator\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/blog.mozilla.org\/en\/mozilla\/ai\/lumigator\/#primaryimage","url":"https:\/\/blog.mozilla.org\/wp-content\/blogs.dir\/278\/files\/2024\/10\/photo-1528904125624-f485d66786ef.jpg","contentUrl":"https:\/\/blog.mozilla.org\/wp-content\/blogs.dir\/278\/files\/2024\/10\/photo-1528904125624-f485d66786ef.jpg","width":2000,"height":1333,"caption":"Credit: Martin Adams \/ Unsplash"},{"@type":"BreadcrumbList","@id":"https:\/\/blog.mozilla.org\/en\/mozilla\/ai\/lumigator\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/blog.mozilla.org\/en\/"},{"@type":"ListItem","position":2,"name":"Introducing Lumigator"}]},{"@type":"WebSite","@id":"https:\/\/blog.mozilla.org\/en\/#website","url":"https:\/\/blog.mozilla.org\/en\/","name":"The Mozilla Blog","description":"News and Updates about Mozilla","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/blog.mozilla.org\/en\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/blog.mozilla.org\/en\/#\/schema\/person\/ff2a2684ab8dcbe5372151857748455d","name":"Kristina Bravo","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/blog.mozilla.org\/en\/#\/schema\/person\/image\/cd320165a9224f3c60c912bf4086a89f","url":"https:\/\/secure.gravatar.com\/avatar\/22fa545a3c48bc13cc1d84d5e09ffbff?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/22fa545a3c48bc13cc1d84d5e09ffbff?s=96&d=mm&r=g","caption":"Kristina Bravo"},"url":"https:\/\/blog.mozilla.org\/en\/author\/kbravo\/"}]}},"_links":{"self":[{"href":"https:\/\/blog.mozilla.org\/en\/wp-json\/wp\/v2\/posts\/75956"}],"collection":[{"href":"https:\/\/blog.mozilla.org\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.mozilla.org\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.mozilla.org\/en\/wp-json\/wp\/v2\/users\/1889"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.mozilla.org\/en\/wp-json\/wp\/v2\/comments?post=75956"}],"version-history":[{"count":0,"href":"https:\/\/blog.mozilla.org\/en\/wp-json\/wp\/v2\/posts\/75956\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/blog.mozilla.org\/en\/wp-json\/wp\/v2\/media\/75958"}],"wp:attachment":[{"href":"https:\/\/blog.mozilla.org\/en\/wp-json\/wp\/v2\/media?parent=75956"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.mozilla.org\/en\/wp-json\/wp\/v2\/categories?post=75956"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.mozilla.org\/en\/wp-json\/wp\/v2\/tags?post=75956"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/blog.mozilla.org\/en\/wp-json\/wp\/v2\/coauthors?post=75956"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}