Skip to main content

Create Your First Project

Purpose​

Create a workspace for one evaluation effort, team, or product area.

When to use it​

Use a new project when you want a clean place to manage datasets, agents, judges, secrets, specs, evals, and results together.

Prerequisites​

  • You can sign in to Spec27.
  • You belong to an organization, or you can create one.

Steps​

  1. Open Projects.
  2. Create a new project and give it a clear name and description.
  3. Open the new project to confirm the overview page loads.
  4. Add the core assets you expect to use:
    • Datasets for prompts, rules, or examples
    • Agents for runnable model logic
    • Secrets if an agent requires protected values
    • Judges if you plan to use judge-based scoring
  5. Review the project overview to confirm the project contains the assets you expect.

Expected result​

You have a project that acts as the home for all evaluation assets and future results.

Good naming guidance​

  • Keep project names tied to a product, workflow, or experiment stream.
  • Use descriptions to explain the goal of the project, not the implementation details.