{"slug":"evalchemy","name":"Evalchemy","kind":"tool","deliveryMethods":["tool"],"kindLabel":"Tool","grade":"D","score":30,"tagline":"Automatic evals for LLMs","description":"Automatic evals for LLMs","tags":["evaluation","reasoning","vllm"],"url":"https://way.space/tool/evalchemy","stars":"—","category":"qa","categories":["qa"],"repo":"https://github.com/mlfoundations/evalchemy","maintainers":[{"login":"mlfoundations","url":"https://github.com/mlfoundations","isMember":false,"verified":false},{"login":"dkimds","url":"https://github.com/dkimds","isMember":false,"verified":false},{"login":"JeniaJitsev","url":"https://github.com/JeniaJitsev","isMember":false,"verified":false}],"scoreWhy":[{"label":"Contributors & bus-factor","detail":"8 recent contributors","direction":"positive"},{"label":"Commit recency","detail":"last commit 303d ago","direction":"positive"},{"label":"Commit cadence","detail":"0 commits in 90 days","direction":"negative"},{"label":"Issue close ratio","detail":"36% of issues closed","direction":"positive"},{"label":"Release cadence","detail":"0 releases in 12 months","direction":"negative"},{"label":"Stars (log-damped)","detail":"613 stars (log-damped)","direction":"positive"},{"label":"Star authenticity","detail":"star-velocity check unavailable — GitHub no longer publishes stargazer timestamps for this repo","direction":"neutral"},{"label":"Engagement-to-star ratio","detail":"healthy engagement (0.44 per star)","direction":"positive"}]}