Aumai Alignment
B+ 90 completed
Ai Ml
cli / python · tiny
23
Files
1,170
LOC
2
Frameworks
4
Languages
Pipeline State
completedRun ID
#303986Phase
doneProgress
1%Started
Finished
2026-04-13 01:31:02LLM tokens
0Pipeline Metadata
Stage
SkippedDecision
skip_scaffold_dupNovelty
44.90Framework unique
—Isolation
—Last stage change
2026-04-16 18:15:42Deduplication group #47583
Member of a group with 1 similar repo(s) — canonical #21608 view group →
Top concepts (4)
Project DescriptiontestingWeb BackendTesting
Generated by Repobility's multi-pass static-analysis pipeline (https://repobility.com)
🧪 Code Distillation
Browse all specs →Sample distilled functions (click for full spec)
EvaluationRunner.get_resultsRetrieves all stored evaluation results associated with a specific dataset identifier. It accepts one string argument, the dataset ID, and returns a list of EvaluationResult objects. If no results are found for the provided ID, the function returns an empty list. This method reads data from an inter
EvaluationRunner.evaluateEvaluates a collection of model outputs against a specified dataset identifier, using the provided model name for context. It accepts a dataset ID string, a list of dictionaries containing model outputs, and an optional model name. The function returns an EvaluationResult object containing an aggreg
EvaluationRunner.__init__Initializes an EvaluationRunner instance by accepting a DatasetRegistry object and an optional ScoringFunction. It stores the provided registry and sets an internal scoring function, defaulting to a predefined scorer if none is supplied. The function also initializes an empty dictionary to hold eval
AI Prompt
Create a command-line interface (CLI) tool in Python for an AI alignment marketplace. I need it to manage datasets and evaluations. Please structure the project using FastAPI for any potential API interactions, include comprehensive testing setup using pytest, and ensure the project structure supports documentation generation and contribution guidelines. The core functionality should be accessible via the CLI, and I'd like to follow best practices for a Python library.
python cli fastapi pytest ai-alignment marketplace command-line library
Generated by gemma4:latest
Catalog Information
The AUMAI Alignment project is a marketplace for AI alignment datasets and evaluations.
Description
AUMAI Alignment is a platform that facilitates the sharing and evaluation of datasets related to artificial intelligence alignment. This includes tools for benchmarking and comparing different approaches to ensuring AI systems align with human values. The project aims to provide a centralized hub for researchers and developers working on AI safety and alignment.
الوصف
هذا المشروع هو منصة لتداول و تقييم البيانات المتعلقة بالتوافق بين الذكاء الاصطناعي والقيم البشرية. يحتوي على أدوات لقياس وتحليل مختلف النهج التي تسعى إلى ضمان أن الأنظمة الذكية تتوافق مع القيم البشرية. يهدف المشروع إلى تقديم مركزًا مركزيًا للمتقدمين في مجال السلامة والتوافق الذكي.
Novelty
7/10Tags
ai-alignment dataset-marketplace evaluation-platform benchmarking-tool artificial-intelligence-safety
Technologies
click fastapi pydantic
Claude Models
claude-opus-4.6
Quality Score
B+
89.7/100
Structure
93
Code Quality
100
Documentation
85
Testing
85
Practices
70
Security
100
Dependencies
80
Strengths
- CI/CD pipeline configured (github_actions)
- Good test coverage (50% test-to-source ratio)
- Code linting configured (ruff (possible))
- Consistent naming conventions (snake_case)
- Low average code complexity \u2014 well-structured code
- Good security practices \u2014 no major issues detected
- Properly licensed project
Security & Health
4.1h
Tech Debt (D)
Medium
DORA Rating
A
OWASP (100%)
Same scanner, your repo: https://repobility.com — Repobility
PASS
Quality Gate
A
Risk (8)
Apache-2.0
License
0.0%
Duplication
Languages
Frameworks
FastAPI pytest
Symbols
variable28
function10
method8
class6
API Endpoints (4)
| Method | Path | Handler | Framework | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Repobility · MCP-ready · https://repobility.com | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| GET | /api/datasets | list_datasets | FastAPI/Flask | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| POST | /api/datasets | register_dataset | FastAPI/Flask | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| GET | /api/datasets/{dataset_id} | get_dataset | FastAPI/Flask | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| GET | /api/evaluations/{dataset_id} | get_evaluations | FastAPI/Flask | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Concepts (4)
| Category | Name | Description | Confidence | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Same scanner, your repo: https://repobility.com — Repobility | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| auto_description | Project Description | > Marketplace for AI alignment datasets and evaluations | 80% | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| arch_layer | testing | Detected testing layer | 70% | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| auto_category | Web Backend | web-backend | 70% | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| business_logic | Testing | Detected from 3 related files | 50% | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Repobility — same analyzer, your code, free for public repos · /scan/
Embed Badge
Add to your README:
BinComp Dependency Hardening
All packages →4 of this repo's dependencies have been scanned for binary hardening. Grade reflects RELRO / stack canary / FORTIFY / PIE coverage.