humanloop-com

AnnouncementWe are thrilled to announce that the Humanloop team is joining Anthropic!From the start, our mission at Humanloop has been to enable the safe and rapid adoption of AI. Now, as the pace of AI progress accelerates, we think Anthropic is the ideal home to amplify our impact.We've had the privilege of working with customers who continually push the boundaries of AI adoption. We owe a huge debt of gratitude for their trust and invaluable feedback along the way. As we sunset the Humanloop platform, we will continue to work closely with our customers to make their transition as smooth as possible.We are grateful to our investors: Albion, Index, YC, Local Globe, UCLTF and many fantastic angels. Building this company has been an incredible journey and we were fortunate to have investors who trusted and supported us at every step.Reflecting on our journey, we're immensely proud of what we built. We were the first development platform for LLM applications and we shaped industry standards for how to manage and evaluate AI. We're excited about this next chapter, joining Anthropic to help build an AI future that benefits everyone.Raza, Jordan, Peterand the whole Humanloop teamThank youTo our customers, investors and supporters, thank you for accompanying us on this journey. We are very excited about what's to come!HomepageMigration GuideMedia Kit© 2020 - 2045 Humanloop, Inc.Terms & Policies --- Humanloop is joining AnthropicView the announcementDownload SVGCopy SVGDownload KitPricingCase StudiesBlogDocsSign inBook a demoYour AI product needs evalsThe LLM evals platform for enterprises. Humanloop gives you the tools that top teams use to ship and scale AI with confidence.Book a demoDevelopEvaluateObserveProblemLLMs break traditional software developmentCode-centric tools and workflows aren't suited for AI systems that demand iterative, data-driven development guided by domain expertise.Traditional SoftwareCodeDeterministicUnit TestsAI DevelopmentCode + Data + PromptsSubjective, StochasticNeeds evalsSolutionHumanloop is the LLM evals platform for teams to ship AI products that succeed01Develop your Prompts and Agents in code or UIPrompt EditorCollaborate with your team in an interactive environment that is backed by evalsVersion ControlEvery edit to your prompts, datasets, evaluators trackedEvery ModelUse the best model, from any AI provider, without the lock in02Evaluate automatically, leveraging domain expertsCI/CDIncorporate into your deployment process to prevent regressionsAI and code automatic evalsScalable and fast evaluationsHuman reviewIntuitive UI to get your subject matter experts to judge the outputs03Observe issues and optimize your systemAlerting and guardrailsGet notified of issues before your users noticeOnline evaluationsCapture user feedback and evals on your live dataTracing and loggingSee each step in a RAG system with the ability to replay any outputsGreat AI teams build on HumanloopHumanloop is our eval platform. You wouldn’t write code without writing unit tests, and you shouldn’t deploy AI models without evaluations. Humanloop ensures we only ship models that meet our quality standards.Edward KimFounder and Chief Architect, GustoWe doubled revenue with our AI product SKUs thanks to Humanloop. Our legal experts now collaborate with our entire team of data scientists, PMs, and engineers to scale our rapidly growing GenAI product lines.Alex McLaughlinVice President of Product at FilevineWe're shipping new AI features about 3x faster. We don't make any new LLM deployment decisions before evaluating new models via Humanloop first.Daniele AlfaroneSr. Director of Engineering at DixaWe saved 15x in costs by fine-tuning smaller models and using Humanloop to match GPT-4 performance.Lucas JansDirector of Product at FMGHumanloop was instrumental in rolling out AI across our organization and we’ve seen huge productivity gains as a result.Nathan LabenzAI lead at AthenaWe're super excited about Humanloop. It drastically reduced the development time of extremely complex features. It’s a huge leap forward and Humanloop has been instrumental.Mohamed ChainFounder and CEO of TwainAlign product, engineering, and domain experts to drive AI developmentProduct managers Increase team velocity and ensure AI performance meets your business objectives.Engineers Let domain experts safely edit prompts in a version controlled environment. Sync with code and run evals in CI/CD to deploy with confidence.Domain experts Give feedback on prompt outputs and experiment with prompt engineering in an intuitive UI.Product managerEngineerDomain expertAccelerate your AI strategy, safelyIterate quickly to evaluate, debug, and optimize your systems based on real-world data.View trust reportCompliance and securityData PrivacyVPC deployment optionEU or US cloud hostedYour data is never trained onSecure AccessRole-Based Access Control (RBAC)Custom SSO + SAML3rd party certified pen testingSOC-2 Type 2GDPRHIPAA Compliance via BAA Ready to build successful AI products?Book a 1:1 demo for a guided tour of the platform tailored to your organization.Book a demoOpenAI Agents SDKOpenAI Agents SDKLLM as a JudgePrompt FilesPlatformLLM EvaluationsPrompt ManagementAI ObservabilityCompliance and SecurityCompanyCareers 6AboutTrust CenterResourcesBlogPricingDocsHigh Agency PodcastNewsletterSubscribe© 2020 - 2045 Humanloop, Inc.Terms & Policies --- v5.0v5.0DocsReferenceChangelogGetting StartedOverviewQuickstartIntegrationsExplanationIntegrating HumanloopKey ConceptsTutorialsEvaluate an Agent in the UIEvaluate an Agent in codeEvaluate a RAG appCapture user feedbackHow-To GuidesMigrating from HumanloopEvaluationPrompt ManagementObservabilityOrganization ManagementReferenceDeployment OptionsSupported ModelsTemplate LibraryVercel AI SDK.prompt and .agent FilesHumanloop Runtime EnvironmentSecurity and ComplianceData ManagementAccess roles (RBACs)SSO and AuthenticationLLMs.txtSign inBook a demoLightOn this pageFrequently Asked QuestionsExporting your dataPrerequisitesStep 1: Access the export toolStep 2: Follow the export instructionsWhat data will be exportedLarge datasetsData format and migrationTimeline and next stepsRecommended timeline:SupportFollowing our acquisition, the Humanloop platform will be sunset on September 8th, 2025. This guide will walk you through exporting all your data from Humanloop, including Files, Versions, Logs, and Evaluations, so you can migrate to your chosen alternative platform. Frequently Asked Questions What will happen to my Humanloop account after September 8th?Your Humanloop account and all associated data will be permanently deleted on September 8th, 2025. This includes all Files, Versions, Logs, Evaluations, and account settings. Please ensure you export any data you need before this date.What happens to my billing?All billing has stopped since July 30th, 2025. You will not be charged for any usage after this date. Any prepaid credits or subscriptions will end on the sunset date, and your payment details will be deleted.What if I can't export my data before the deadline?Our aim has been to give as much notice as possible, whilst working through legal constraints. We sent an email to all Humanloop users on July 17th, 2025 notifying you of the shutdown.We have done our best to make the export process as easy as possible. However, if you run into issues, please contact the support team at support@humanloop.com.Unfortunately, after September 8th, 2025, all data will be permanently inaccessible.What alternatives do you recommend?There are now many great tools for AI evaluation and prompt management, with new options emerging all the time. We recommend you survey your options and try out what works for you.Some options we currently recommend in particular are: Langfuse Braintrust Exporting your data To help you migrate your data, we’ve created a comprehensive export tool that downloads all your Humanloop data in a structured format. Prerequisites A Humanloop API key from the API Keys page uv installed on your system (or Python 3.10+) git to clone the Humanloop Export Tool repository Step 1: Access the export tool Clone the Humanloop Export Tool repository: $git clone https://github.com/humanloop/humanloop-export.git$cd humanloop-export Step 2: Follow the export instructions The export tool repository contains comprehensive instructions for: Configuration: Setting up your API credentials and export preferences Selective exports: Choosing specific directories or data types to export Running the export: Step-by-step commands to download your data Output structure: Understanding the exported data format Troubleshooting: Resolving common issues during export Complete instructions: Please refer to the repository README for detailed, up-to-date export instructions. The repository contains the most current configuration options and usage guidelines. What data will be exported The export tool downloads: Files: All your Prompts, Tools, Datasets, Flows, Agents, and Evaluators Versions: Complete version history and configurations Deployments: Environment deployment information Logs: Usage logs and execution history (configurable) Evaluations: Evaluation results, runs, and statistics Datapoints: Dataset contents and test data Large datasets If you have more than 1 million Logs or very large datasets, contact our support team at support@humanloop.com. We can arrange a custom export process to ensure you receive all your data efficiently. Data format and migration The exported data is provided in JSON and JSONL formats, making it compatible with most data processing tools and alternative platforms. You may need to transform the data structure to match your chosen migration destination’s requirements. Timeline and next steps Important deadline: Complete your data export well before September 8th, 2025. After this date, the platform and all data will be permanently inaccessible. We recommend exporting your data as soon as possible while support is available. Recommended timeline: Immediately: Export your data using the export tool Verify export: Check that all critical data has been successfully downloaded Plan migration: Research and select your alternative platform Test migration: Import a subset of data to validate the migration process Complete migration: Fully migrate to your new platform before September 8th Support For assistance with: Export tool issues: Open an issue in the repository General migration questions: Contact our support team at support@humanloop.com Large dataset exports: Reach out to support for custom export arrangements We’re committed to helping you successfully migrate your data during this transition period. --- Humanloop is joining AnthropicView the announcementDownload SVGCopy SVGDownload KitPricingCase StudiesBlogDocsSign inBook a demoOpenAI Agents SDKOpenAI Agents SDKLLM as a JudgePrompt FilesPlatformLLM EvaluationsPrompt ManagementAI ObservabilityCompliance and SecurityCompanyCareers 6AboutTrust CenterResourcesBlogPricingDocsHigh Agency PodcastNewsletterSubscribe© 2020 - 2045 Humanloop, Inc.Terms & Policies