{"slug":"autoevals","name":"Autoevals","kind":"tool","deliveryMethods":["tool"],"kindLabel":"Tool","grade":"B","score":76,"tagline":"","description":"Autoevals uses model-graded evaluation for a variety of subjective tasks including fact checking, safety, and more. Many of these evaluations are adapted from OpenAI's excellent [evals](https://github.com/openai/evals) project but are implemented so you can flexibly run them on individual examples, tweak the prompts, and debug their outputs.","tags":["evaluation","braintrust","factuality"],"url":"https://way.space/tool/autoevals","stars":"—","category":"qa","categories":["qa"],"repo":"https://github.com/braintrustdata/autoevals","license":"MIT","maintainers":[{"login":"braintrustdata","url":"https://github.com/braintrustdata","isMember":false,"verified":false},{"login":"ankrgyl","url":"https://github.com/ankrgyl","isMember":false,"verified":false},{"login":"ibolmo","url":"https://github.com/ibolmo","isMember":false,"verified":false},{"login":"AbhiPrasad","url":"https://github.com/AbhiPrasad","isMember":false,"verified":false}],"scoreWhy":[{"label":"Contributors & bus-factor","detail":"29 recent contributors","direction":"positive"},{"label":"Commit recency","detail":"last commit 1d ago","direction":"positive"},{"label":"Commit cadence","detail":"8 commits in 90 days","direction":"positive"},{"label":"Issue close ratio","detail":"71% of issues closed","direction":"positive"},{"label":"Release cadence","detail":"7 releases in 12 months","direction":"positive"},{"label":"Stars (log-damped)","detail":"1,064 stars (log-damped)","direction":"positive"},{"label":"Star authenticity","detail":"star-velocity check unavailable — GitHub no longer publishes stargazer timestamps for this repo","direction":"neutral"},{"label":"Engagement-to-star ratio","detail":"healthy engagement (0.32 per star)","direction":"positive"}]}