llmonitor

The AI Observability and Evaluation PlatformObservability, Prompt management, Evaluations, and Product analyticsto build AI applications with confidence.Get StartedRequest a demoPowering the world's best AI teams.From next-gen startups to established enterprises.Chatbot AnalyticsUnderstand the gap between your chatbot and your users.See how your LLMs performs in real-time and how users interact with it.Deliver reliable AI experiences.Built for every LLM use-case. Whether you're building internal tools or customer-facing applications.What's remote work policy?According to our latest HR policy, employees can work remotely up to 3 days per week. Core hours are 10 AM - 4 PM.Remote Work Policy.pdfCan you help me set up my development environment?I'll guide you through our standard setup process. First, let's install the required dependencies...Internal KnowledgeHelp your team access company knowledge and automate workflows faster. Monitor usage and improve from real feedback.How do I upgrade my subscription?I'll help you upgrade your subscription. You can upgrade from your account settings. Would you like me to guide you through the process?Yes pleaseGreat! First, go to Settings > Billing. You'll see your current plan and available upgrade options...Customer SupportBuild customer-facing chatbots that understand your docs and provide accurate responses. Track satisfaction and improve continuously.Create a sales report for Q4I'll analyze the Q4 data and create a report. This will include sales metrics, user growth, and key achievements.Querying data...Creating charts...Include month-over-month comparisonsI'll add MoM comparisons for all key metrics. Would you like me to highlight significant changes above a certain threshold?AgentsDeploy autonomous agents that execute complex tasks. Monitor performance in real-time and catch errors early.Minutes to magic.Self-host or go cloud and get started in minutes.Get Started (it's free)Schedule a DemoOpen SourceSelf Hostable1-line IntegrationPrompt TemplatesChat ReplaysAnalyticsTopic ClassificationAgent TracingCustom DashboardsScore LLM responsesPII MaskingFeedback TrackingOpen SourceSelf Hostable1-line IntegrationPrompt TemplatesChat ReplaysAnalyticsTopic ClassificationAgent TracingCustom DashboardsScore LLM responsesPII MaskingFeedback TrackingDebug LLM agentsLog all your prompts and results, see how agents are performing in production.Traces & error stack tracesInstant search & filtersLabel data for fine-tuningAnalyticsTrack and analyze the performance and costs of your GenAI projects, and how users interact with your app.Model usages & costsAnalyze frequent topicsUser satisfactionCustom dashboardsIterate on promptsCreate templates and collaborate on prompts with non-technical teammates.Clean your source-codeVersioningA/B testingLearn moreSecurityEnterprise readyLunary is SOC 2 Type II and ISO 27001 certified and designed to be self-hosted. Stay compliant and safeguard your sensitive data.Schedule a CallPII MaskingSafeguard user personal information. No more GDPR headaches.Manage AccessRBAC and SSO. The right eyes on the right data, always.Hosted in your CloudDeploy in your VPC with Kubernetes or Docker. Your infrastructure, your control.SDKsAny LLM. Any framework.Seamless integration with zero friction. Our SDKs are designed to be lightweight and integrate naturally into your codebase.OpenAI captureLangChainTrack messagesTraces & errorsTemplatesTrack usersPythonimport lunary from openai import OpenAI client = OpenAI() lunary.monitor(client) chat_completion = client.chat.completions.create( messages=[{"role": "user", "content": "Hello"}], )Expand codeIntegrationsCapture LLM data across your entire stack.Monitor and analyze AI interactions across your stack, with seamless integration to your preferred data destinations.Explore all integrationsToolsAnd much more.Human reviewsAllow your team to judge responses from your LLMs.PII MaskingSafeguard user personal information. No more GDPR headaches.LanguagesUnderstand what languages your users are speaking.Multi-modalFull support for text, audio and images.Alerts systemReceive notifications when agents are not performing as expected.Instant SearchSearch and filter anything. In milliseconds.PlaygroundExperiment with prompts and LLM models. No coding required.ClassifyGroup chats into topics. Uncover trends instantly.TestimonialsLunary is trusted by the best teams, from next-gen startups to established enterprises.Minutes to magic.Self-host or go cloud and get started in minutes.Get Started (it's free)Schedule a DemoOpen SourceSelf Hostable1-line IntegrationPrompt TemplatesChat ReplaysAnalyticsTopic ClassificationAgent TracingCustom DashboardsScore LLM responsesPII MaskingFeedback TrackingOpen SourceSelf Hostable1-line IntegrationPrompt TemplatesChat ReplaysAnalyticsTopic ClassificationAgent TracingCustom DashboardsScore LLM responsesPII MaskingFeedback TrackinglunaryProductEnterpriseDocumentationPricingFAQCompanyCareersSecurityContact SupportContact SalesEcosystemAI/LLM NewsMistral TokenizerAnthropic TokenizerOpenAI TokenizerLlama TokenizerDeepseek TokenizerStructured Output Schema GeneratorTool Calls Schema GeneratorCompare Models© 2026 Lunary LLC. All rights reserved.Terms of UsePrivacy PolicyDPA --- Find the right planLunary supports teams of all sizes, with pricing that scales.FreeFor personal projects.No credit card required.$0/ moSign Up10k events per month3 projects30 days logs retentionTeamStart scaling your project with more resources.$20/ user / moSign Up50k events per monthAI PlaygroundUnlimited projects1 year historyAdvanced featuresEnterpriseCustom plans for larger teams with personalized needs.CustomGet a QuoteSelf-hostedSSOGranular Access ControlPII MaskingSLAWhite labelingData Warehouse connectorsLegendary supportPowering the world's best AI teams.From next-gen startups to established enterprises.FreeTeamEnterpriseBasic FeaturesLogs / Events10k50k includedthen $10 / 50k / monthCustomMaximum Seats110CustomHistory1 month1 yearCustomSmart ViewsUnlimited PromptsFull API AccessAI Playground1000 / monththen $0.05 per queryUnlimited ProjectsCustom DashboardsHuman ReviewsTopicsCSV & JSONL ExportsSupportPrioritySame-Day+ Shared Slack/Teams channelHost on your serversSSO / SAMLGranular Access ControlPII MaskingSOC2 & ISO27001 Reports99.9% SLACustom InvoicingData Warehouse connectorsAudit PapertrailWhite LabelTechnical Account ManagerTestimonialsLunary is trusted by the best teams, from next-gen startups to established enterprises.“Lunary has proven to be an invaluable tool and great addition to our technology stack. Its contribution has significantly enhanced the capabilities of our GenAI solutions, bringing real value by optimizing our processes and offering advanced insights.”Ioannis TarlasProduct Manager, DHL“Essential to supporting Close's GenAI work. The Lunary team consistently delivers improvements and new features quickly, and their Kubernetes setup is of high quality.”Thomas SteinacherCTO & Co-founder, Close.com, CloseFrequently Asked QuestionsWhat happens if I go over the events limit?If you exceed the limit 2 days in row, your account will be limited but the data will still be captured. That means exceptional bursts are fine. You'll regain full access once you upgrade your account or stay below the limit for 3 consecutive days.Where is the data hosted?Our data is hosted in Europe and compliant with GDPR. We can also accomodate on-premises hosting. Read more about data security.How do I cancel my subscription?You can cancel your subscription by clicking on the 'Customer Portal' button in the billing section of the dashboard.Do you offer discounts for students or non-profits?Yes, we offer discounts for students, non-profits, and open-source projects without commercial use. Please contact us with details about your project to claim a discount.Can you accommodate quarterly billing?Yes, we can accommodate quarterly billing. Please contact us to discuss your needs.Is there an agency-specific pricing?For companies and individuals building solutions for clients, we offer flat and predictable plans starting from $US 400/month. Create and share projects for each client. Reach out to get a precise quote.Is self-hosting free?You can self-host the Community Edition for free. The Enterprise Edition, with support for Docker, Kubernetes, and more, is paid. Check the pricing page for more information.Is there a migration path from cloud to self-hosting, if required?Yes, if you are migrating from the cloud-hosted version to a paid self-hosted plan, contact us and we will help you migrate your data.Minutes to magic.Self-host or go cloud and get started in minutes.Get Started (it's free)Schedule a DemoOpen SourceSelf Hostable1-line IntegrationPrompt TemplatesChat ReplaysAnalyticsTopic ClassificationAgent TracingCustom DashboardsScore LLM responsesPII MaskingFeedback TrackingOpen SourceSelf Hostable1-line IntegrationPrompt TemplatesChat ReplaysAnalyticsTopic ClassificationAgent TracingCustom DashboardsScore LLM responsesPII MaskingFeedback TrackinglunaryProductEnterpriseDocumentationPricingFAQCompanyCareersSecurityContact SupportContact SalesEcosystemAI/LLM NewsMistral TokenizerAnthropic TokenizerOpenAI TokenizerLlama TokenizerDeepseek TokenizerStructured Output Schema GeneratorTool Calls Schema GeneratorCompare Models© 2026 Lunary LLC. All rights reserved.Terms of UsePrivacy PolicyDPA --- Let's TalkTalk to our teamSchedule a call to see if Lunary could be a fit for your company. We'll bring someone technical.We speakEnglish 🇬🇧 French 🇫🇷 Spanish 🇪🇸EmailContinuelunaryProductEnterpriseDocumentationPricingFAQCompanyCareersSecurityContact SupportContact SalesEcosystemAI/LLM NewsMistral TokenizerAnthropic TokenizerOpenAI TokenizerLlama TokenizerDeepseek TokenizerStructured Output Schema GeneratorTool Calls Schema GeneratorCompare Models© 2026 Lunary LLC. All rights reserved.Terms of UsePrivacy PolicyDPA --- 20+ integrations for your LLM dataLeverage your LLM and chatbots data with 20+ integrations.SourcesDestinationsAnalyticsAutomationAnthropicSourcesMonitor Anthropic with our native SDK integrations.FlowiseSourcesMonitor your Flowise chatbots with the native Lunary integration.Coming SoonLangChainSourcesCapture data from your LangChain or LangGraph agents into Lunary.OpenRouterSourcesMonitor and see the price usage of all your OpenRouter models.IBM WatsonXSourcesMonitor your IBM WatsonX models with our native integrationMistralSourcesMonitor your Mistral queries with our OpenAI or LangChain integrations.GrokSourcesMonitor your Grok queries with our OpenAI or Anthropic integrations.Fireworks AISourcesIntegrate Fireworks AI with Lunary.RagasSourcesReport the result of your RAGAS evaluations into Lunary.Coming SoonPowerBIAdd and analyze your chatbot and LLM data directly within your PowerBI.EnterpriseTableauDestinationsAdd and analyze your chatbot and LLM data directly within your Tableau.EnterpriseMySQLDestinationsMirror your Lunary data into an MySQL database.EnterpriseGeminiSourcesIntegrate Gemini with Lunary.AWS BedrockSourcesIntegrate AWS Bedrock with Lunary.AmplitudeDestinations, AnalyticsIntegrate Amplitude with Lunary.EnterpriseAirbyteDestinationsIntegrate Airbyte with Lunary.EnterpriseSegmentDestinationsIntegrate Segment with Lunary.EnterpriseEmail / SMTPAutomationReceive emails about your LLM usage and more.SlackAutomationReceive alerts about errors or anomalies in your app.Coming SoonZapierAutomationIntegrate Zapier with Lunary.EnterpriseRedshiftSourcesIntegrate Redshift with Lunary.Coming SoonPostHogAnalytics, DestinationsSend your Lunary to PostHog for further analysis.Coming SoonOpenLLMetrySourcesIntegrate OpenLLMetry with Lunary.Coming SoonLlamaIndexSourcesIntegrate LlamaIndex with Lunary.Coming SoonSQL ServerDestinationsMirror your Lunary data into an SQL Server database.EnterpriseDatabricksDestinationsIntegrate Databricks with Lunary.EnterpriseSnowflakeDestinationsIntegrate Snowflake with Lunary.EnterpriseLiteLLMSourcesIntegrate LiteLLM with Lunary.LangflowSourcesIntegrate Langflow with Lunary.Coming SoonGoogle BigQueryDestinationsConnect your chatbot and LLM data to a BigQuery dataset.EnterpriseOpenAISourcesUse our native OpenAI integration to automatically track and report data.Azure OpenAISourcesIntegrate Azure OpenAI with Lunary.Minutes to magic.Self-host or go cloud and get started in minutes.Get Started (it's free)Schedule a DemoOpen SourceSelf Hostable1-line IntegrationPrompt TemplatesChat ReplaysAnalyticsTopic ClassificationAgent TracingCustom DashboardsScore LLM responsesPII MaskingFeedback TrackingOpen SourceSelf Hostable1-line IntegrationPrompt TemplatesChat ReplaysAnalyticsTopic ClassificationAgent TracingCustom DashboardsScore LLM responsesPII MaskingFeedback TrackinglunaryProductEnterpriseDocumentationPricingFAQCompanyCareersSecurityContact SupportContact SalesEcosystemAI/LLM NewsMistral TokenizerAnthropic TokenizerOpenAI TokenizerLlama TokenizerDeepseek TokenizerStructured Output Schema GeneratorTool Calls Schema GeneratorCompare Models© 2026 Lunary LLC. All rights reserved.Terms of UsePrivacy PolicyDPA