Metaphi AI

Terms of Service

Effective date: January 1, 2026

Overview

These Terms of Service ("Terms") govern your access to and use of the websites, platforms, and services (collectively, the "Services") operated by Metaphi, Inc. ("Metaphi," "we," "our," or "us"), including metaphi.ai, Simhub, Evals, and our API. By accessing or using any of our Services, you agree to be bound by these Terms.

Metaphi builds reinforcement learning environments and evaluation infrastructure for coding agents. Our Services enable researchers, AI engineers, and domain experts to author, review, and annotate benchmark tasks, execute coding agent evaluations, and access benchmark leaderboards and results.

1. Acceptance of Terms

By accessing or using our Services, you confirm that you are at least 18 years old and have the legal capacity to enter into these Terms. If you are using the Services on behalf of an organization, you represent and warrant that you have the authority to bind that organization to these Terms, and "you" refers to both you individually and that organization.

If you do not agree to these Terms, you must not access or use our Services.

2. Description of Services

Metaphi provides the following platform surfaces and capabilities:

  • Simhub: An expert interface for benchmark task authoring, review, annotation, and quality assurance. Experts use Simhub to create, validate, and refine evaluation tasks for coding agents.
  • Evals: A platform for benchmark leaderboards, evaluation results, and run analytics. Evals displays aggregate and per-model performance data from coding agent evaluations.
  • API: A programmatic interface for executing coding agent evaluations against benchmark tasks, retrieving evaluation results, and managing benchmark datasets.
  • Website: Our public website at metaphi.ai, which provides information about our research, team, and services.

We may modify, suspend, or discontinue any part of the Services at any time, with or without notice.

3. Account Registration

To access authenticated features of the Services, you must create an account using Google OAuth or another authentication method we provide. You are responsible for:

  • Maintaining the confidentiality and security of your account credentials
  • All activities that occur under your account, whether or not authorized by you
  • Notifying us immediately at legal@metaphi.ai of any unauthorized access to or use of your account

We reserve the right to suspend or terminate accounts that we reasonably believe have been compromised or are being used in violation of these Terms.

4. Expert Participation

If you participate as a subject matter expert (SME) through Simhub, additional terms apply:

  • Onboarding: You may be required to complete a pre-qualification assessment and provide profile information including your expertise domains, programming language proficiencies, and payout details.
  • Task Work: You agree to perform task authoring, review, and annotation work in accordance with the guidelines, quality standards, and deadlines communicated through the platform.
  • Compensation: Expert compensation rates, payout schedules, and payment methods will be communicated during onboarding. Metaphi will process payouts in accordance with the terms agreed upon during your engagement setup.
  • Quality Standards: We reserve the right to reject, request revision of, or decline to publish tasks or reviews that do not meet our quality standards. Repeated failure to meet quality standards may result in reduced task assignments or termination of your expert engagement.

5. Acceptable Use

You agree not to use the Services to:

  • Violate any applicable laws, regulations, or third-party rights
  • Submit content that infringes on the intellectual property rights of others
  • Submit malicious code, viruses, or any code designed to disrupt, damage, or gain unauthorized access to systems or data
  • Attempt to circumvent security measures, access controls, or rate limits
  • Interfere with or disrupt the Services or their underlying infrastructure
  • Use automated systems, bots, or scrapers to access the Services without our written permission
  • Reverse engineer, decompile, or disassemble any part of the Services
  • Misrepresent your identity, qualifications, or affiliation when registering or participating as an expert
  • Use benchmark data, evaluation results, or leaderboard data in a manner that violates our data licensing terms

6. Intellectual Property

6.1 Metaphi Platform: The Services, including their design, features, source code, algorithms, evaluation frameworks, benchmark infrastructure, and underlying technology, are owned by Metaphi, Inc. and protected by intellectual property laws. You may not copy, modify, distribute, create derivative works of, or reverse engineer any part of the Services without our prior written consent.

6.2 Benchmark Datasets and Results: Benchmark datasets, evaluation results, leaderboard data, and associated metadata published by Metaphi are the property of Metaphi, Inc. Use of published benchmark data is subject to the specific license terms accompanying each dataset release (e.g., on HuggingFace). Where no license is specified, all rights are reserved.

6.3 Expert Contributions: By submitting tasks, annotations, reviews, ground-truth solutions, or other content through Simhub ("Expert Contributions"), you grant Metaphi a perpetual, irrevocable, worldwide, royalty-free, sublicensable license to use, reproduce, modify, adapt, publish, distribute, and create derivative works from your Expert Contributions for the purpose of building, publishing, and operating benchmarks, evaluation infrastructure, and related research. You represent that you have the right to grant this license and that your contributions do not infringe on any third-party rights.

6.4 Your Content: Other than Expert Contributions, you retain ownership of content you provide to the Services. By submitting content, you grant us a limited license to process it solely for the purpose of providing the Services to you.

7. Confidentiality

In the course of using the Services, you may receive or have access to confidential information belonging to Metaphi, including but not limited to:

  • Unpublished benchmark tasks, evaluation criteria, and ground-truth solutions
  • Proprietary codebase data acquired by Metaphi under data purchase agreements
  • Pre-release evaluation results and agent performance data
  • Platform architecture, algorithms, and technical implementation details

You agree to hold all confidential information in strict confidence, not to disclose it to any third party, and not to use it for any purpose other than your authorized use of the Services. This obligation survives termination of your account or these Terms. If you are subject to a separate Non-Disclosure Agreement with Metaphi, the terms of that agreement apply in addition to this section.

8. Evaluation Outputs and Agent Execution

When coding agents are executed against benchmark tasks through our Services:

  • Execution Artifacts: Model outputs, trajectories, tool call logs, scores, and other artifacts generated during evaluation runs are the property of Metaphi. We may use these artifacts for research, benchmark publication, leaderboard ranking, and service improvement.
  • No Guarantees: Evaluation results are provided for informational and research purposes. We do not guarantee the accuracy, completeness, or reproducibility of any evaluation result. Scores and rankings may change as benchmarks are updated.
  • Publication: Aggregate and anonymized evaluation results may be published on our leaderboards, in research papers, and through other channels. We will not publish raw agent outputs or proprietary model details without authorization from the model provider.

9. Third-Party Services

The Services integrate with and rely on third-party services, including:

  • Google Cloud Platform and Firebase: For infrastructure, storage, and authentication
  • Modal: For serverless compute and agent execution
  • HuggingFace: For dataset hosting and distribution
  • AI Model Providers (Anthropic, OpenAI, Google): For coding agent evaluation
  • DocuSign: For agreement execution

Your use of the Services may be subject to the terms and policies of these third-party providers. We are not responsible for the availability, functionality, or data practices of third-party services. Disruptions to third-party services may impact the availability of our Services.

10. Data Licensing and Purchased Codebases

Metaphi acquires proprietary codebases and data from third parties under data purchase agreements for the purpose of benchmark construction. If you interact with benchmark tasks derived from purchased codebases:

  • You acknowledge that the underlying source material is proprietary and subject to contractual restrictions
  • You agree not to extract, reproduce, or redistribute the underlying source code or data beyond what is necessary for your authorized use of the Services
  • You agree not to attempt to identify, contact, or reverse-engineer the source of purchased codebase data

11. Disclaimer of Warranties

The Services are provided "as is" and "as available" without warranties of any kind, whether express or implied, including but not limited to implied warranties of merchantability, fitness for a particular purpose, non-infringement, and any warranties arising out of course of dealing or usage of trade.

We do not warrant that:

  • The Services will be uninterrupted, timely, secure, or error-free
  • Evaluation results, scores, or rankings will be accurate or reproducible
  • The Services will meet your specific requirements
  • Any defects in the Services will be corrected

12. Limitation of Liability

To the maximum extent permitted by applicable law, Metaphi, Inc., its officers, directors, employees, and agents shall not be liable for any indirect, incidental, special, consequential, or punitive damages, or any loss of profits, revenue, data, use, goodwill, or other intangible losses resulting from:

  • Your access to, use of, or inability to use the Services
  • Any unauthorized access to or alteration of your data or account
  • Any errors, omissions, or inaccuracies in evaluation results, benchmark data, or leaderboard rankings
  • Any conduct or content of any third party on the Services
  • Any interruption or cessation of the Services

In no event shall Metaphi's total aggregate liability for all claims arising out of or relating to these Terms or the Services exceed the greater of (a) the amounts you paid to Metaphi in the twelve (12) months preceding the claim, or (b) one hundred U.S. dollars ($100).

13. Indemnification

You agree to indemnify, defend, and hold harmless Metaphi, Inc., its officers, directors, employees, and agents from and against any claims, liabilities, damages, losses, costs, and expenses (including reasonable attorneys' fees) arising out of or relating to:

  • Your use of the Services in violation of these Terms
  • Your Expert Contributions or other content you submit to the Services
  • Your violation of any applicable law, regulation, or third-party right
  • Your breach of any representation or warranty in these Terms

14. Termination

We may suspend or terminate your access to the Services at any time, with or without cause, and with or without notice, including for violation of these Terms. You may terminate your account at any time by contacting us at legal@metaphi.ai.

Upon termination:

  • Your right to access and use the Services ceases immediately
  • We may delete your account data in accordance with our Privacy Policy
  • Sections that by their nature should survive termination will survive, including Intellectual Property, Confidentiality, Limitation of Liability, Indemnification, Governing Law, and Dispute Resolution

Expert Contributions that have been incorporated into published benchmarks will be retained in accordance with the license granted in Section 6.3, regardless of account termination.

15. Dispute Resolution

Informal Resolution: Before filing any formal legal claim, you agree to first contact us at legal@metaphi.ai and attempt to resolve the dispute informally for at least 30 days.

Binding Arbitration: If the dispute is not resolved informally, either party may elect to resolve it through binding arbitration administered by the American Arbitration Association (AAA) under its Commercial Arbitration Rules. The arbitration will be conducted in Wilmington, Delaware. The arbitrator's decision will be final and binding and may be entered as a judgment in any court of competent jurisdiction.

Class Action Waiver: You agree to resolve disputes with Metaphi on an individual basis only. You waive any right to participate in a class action, class arbitration, or any other representative proceeding.

Exceptions: Either party may seek injunctive or equitable relief in any court of competent jurisdiction to protect its intellectual property rights or confidential information.

16. Governing Law

These Terms are governed by and construed in accordance with the laws of the State of Delaware, United States, without regard to its conflict of law principles. Any legal action not subject to arbitration shall be brought exclusively in the state or federal courts located in Delaware.

17. Export Compliance

You agree to comply with all applicable export and re-export control laws and regulations, including the U.S. Export Administration Regulations (EAR) and sanctions programs administered by the U.S. Office of Foreign Assets Control (OFAC). You represent that you are not located in, or a resident or national of, any country subject to U.S. embargo, and that you are not on any U.S. government restricted party list.

18. Severability

If any provision of these Terms is held to be invalid, illegal, or unenforceable, the remaining provisions will continue in full force and effect. The invalid provision will be modified to the minimum extent necessary to make it valid and enforceable while preserving its original intent.

19. Entire Agreement

These Terms, together with our Privacy Policy and any separate agreements you have entered into with Metaphi (including NDAs, data purchase agreements, or expert engagement agreements), constitute the entire agreement between you and Metaphi regarding the Services. In the event of a conflict between these Terms and a separate signed agreement, the separate agreement will control with respect to the subject matter it covers.

20. Changes to Terms

We may modify these Terms at any time. When we make material changes, we will update the "Effective date" at the top of this page and make reasonable efforts to notify affected users via email or through a prominent notice on our website at least 30 days before the changes take effect. Your continued use of the Services after the effective date of any changes constitutes your acceptance of the modified Terms.

21. Contact Us

If you have questions about these Terms, please contact us at legal@metaphi.ai.