{"schema_version":"onlylabs.public_signal.v1","title":"SambaNova Systems Fork: sambanova/lm-evaluation-harness","description":"SambaNova Systems fork signal with public source context, captured evidence pages, related signals, and category-scoped analysis context.","url":"https://onlylabs.fyi/signals/6e9f1339-cb77-47c4-8165-d2d1a578c232","json_url":"https://onlylabs.fyi/signals/6e9f1339-cb77-47c4-8165-d2d1a578c232/signal.json","generated_at":"2026-06-11T04:19:35.414643+00:00","org":{"slug":"sambanova","name":"SambaNova Systems","category":"neocloud","category_label":"Neocloud","dossier_url":"https://onlylabs.fyi/labs/sambanova","dossier_json_url":"https://onlylabs.fyi/labs/sambanova/dossier.json"},"related_urls":{"signal":"https://onlylabs.fyi/signals/6e9f1339-cb77-47c4-8165-d2d1a578c232","signal_json":"https://onlylabs.fyi/signals/6e9f1339-cb77-47c4-8165-d2d1a578c232/signal.json","source":"https://github.com/sambanova/lm-evaluation-harness","lab_dossier":"https://onlylabs.fyi/labs/sambanova","lab_dossier_json":"https://onlylabs.fyi/labs/sambanova/dossier.json","analysis":"https://onlylabs.fyi/analysis/sambanova","analysis_json":"https://onlylabs.fyi/analysis/sambanova/analysis.json","analysis_evidence_json":"https://onlylabs.fyi/analysis/sambanova/evidence.json","category":"https://onlylabs.fyi/neoclouds","category_json":"https://onlylabs.fyi/neoclouds.json","category_feed":"https://onlylabs.fyi/neoclouds/feed.xml","category_signals_json":"https://onlylabs.fyi/signals.json?category=neocloud","topic":"https://onlylabs.fyi/topics/forks","topic_signals_json":"https://onlylabs.fyi/topics/forks/signals.json?category=neocloud","topic_feed":"https://onlylabs.fyi/topics/forks/feed.xml?category=neocloud","data_business":null},"answer_pack":{"answer":"SambaNova Systems forked sambanova/lm-evaluation-harness (forked from EleutherAI/lm-evaluation-harness). This fork signal points to upstream code the lab may be inspecting, patching, or building on. High-signal details: repo sambanova/lm-evaluation-harness · parent EleutherAI/lm-evaluation-harness. onlylabs links this event to 1 captured evidence page and 1 related fork signal.","signal_desk":"forks","source_context":{"source_url":"https://github.com/sambanova/lm-evaluation-harness","source_host":"github.com","occurred_at":"2024-03-08T16:10:36+00:00","first_seen_at":"2026-06-05T22:32:07.650067+00:00","date_source":"source","context":"forked from EleutherAI/lm-evaluation-harness"},"context_markers":[{"label":"Lab","value":"SambaNova Systems","source":"signal"},{"label":"Signal desk","value":"forks","source":"signal"},{"label":"Source host","value":"github.com","source":"source"},{"label":"Repository","value":"sambanova/lm-evaluation-harness","source":"source"},{"label":"Parent","value":"EleutherAI/lm-evaluation-harness","source":"source"},{"label":"Stars","value":"3","source":"traction"},{"label":"Watch term","value":"Eval methodology","source":"evidence"},{"label":"Watch term","value":"Model card","source":"model"},{"label":"Watch term","value":"Infrastructure","source":"evidence"}],"evidence_coverage":{"target_pages":1,"captured_pages":1,"readable_pages":1,"capture_methods":["plain"],"missing_page_urls":[],"failed_page_urls":[],"blocked_page_urls":[],"page_urls":["https://github.com/sambanova/lm-evaluation-harness"],"related_signals":1,"has_source_url":true,"latest_page_fetched_at":"2026-06-11T04:19:35.414643+00:00"},"data_business":{"matches":false,"lanes":[],"matched_terms":[],"score":null,"reason":null},"agent_handoff":{"signal_json":"https://onlylabs.fyi/signals/6e9f1339-cb77-47c4-8165-d2d1a578c232/signal.json","dossier_json":"https://onlylabs.fyi/labs/sambanova/dossier.json","analysis_json":"https://onlylabs.fyi/analysis/sambanova/analysis.json","analysis_evidence_json":"https://onlylabs.fyi/analysis/sambanova/evidence.json","topic_signals_json":"https://onlylabs.fyi/topics/forks/signals.json?category=neocloud","topic_feed":"https://onlylabs.fyi/topics/forks/feed.xml?category=neocloud","category_signals_json":"https://onlylabs.fyi/signals.json?category=neocloud","data_radar_json":null,"opportunities_json":null},"analysis_playbook":{"objective":"Turn fork activity into a map of upstream tools, libraries, model utilities, agent frameworks, and research dependencies being inspected or adapted.","evidence_focus":["forked parent repo","repo owner","language","description","stars","org and recency"],"extraction_questions":["Which upstream projects are repeated across labs?","Which forks point to evals, agents, infrastructure, model tooling, or data pipelines?","Which low-profile forks could precede a release or hiring wave?","Which labs are converging on the same technical adjacency?"],"signal_questions":["What upstream dependency or technical adjacency does this fork reveal?","Which upstream projects are repeated across labs?","Which forks point to evals, agents, infrastructure, model tooling, or data pipelines?","Do the 1 related fork signals show a repeated pattern?"],"output_fields":["org","upstream_repo","language","technical_theme","evidence_url"],"data_business_relevance":"Data-business lane extraction is scoped to frontier labs; for this category, keep conclusions tied to category-specific strategy, source evidence, and follow-up questions.","required_sources":[{"label":"signal_json","url":"https://onlylabs.fyi/signals/6e9f1339-cb77-47c4-8165-d2d1a578c232/signal.json","required":true},{"label":"source","url":"https://github.com/sambanova/lm-evaluation-harness","required":true},{"label":"dossier_json","url":"https://onlylabs.fyi/labs/sambanova/dossier.json","required":true},{"label":"analysis_evidence_json","url":"https://onlylabs.fyi/analysis/sambanova/evidence.json","required":true},{"label":"topic_signals_json","url":"https://onlylabs.fyi/topics/forks/signals.json?category=neocloud","required":false},{"label":"data_radar_json","url":null,"required":false}],"expected_output":["one-paragraph source-grounded interpretation","category-specific implication","confidence and missing evidence","recommended next source to inspect"],"prompt_seed":"Using only the linked onlylabs JSON, captured source context, and cited evidence, analyze SambaNova Systems's fork signal \"sambanova/lm-evaluation-harness\" for neocloud strategy."},"semantic_triples":[{"subject":"SambaNova Systems","predicate":"forked","object":"sambanova/lm-evaluation-harness","text":"SambaNova Systems forked sambanova/lm-evaluation-harness."},{"subject":"sambanova/lm-evaluation-harness","predicate":"is classified as","object":"fork signal","text":"sambanova/lm-evaluation-harness is classified as fork signal."},{"subject":"sambanova/lm-evaluation-harness","predicate":"belongs to","object":"forks desk","text":"sambanova/lm-evaluation-harness belongs to forks desk."},{"subject":"sambanova/lm-evaluation-harness","predicate":"has context","object":"forked from EleutherAI/lm-evaluation-harness","text":"sambanova/lm-evaluation-harness has context forked from EleutherAI/lm-evaluation-harness."},{"subject":"sambanova/lm-evaluation-harness","predicate":"has evidence coverage","object":"1 captured evidence page","text":"sambanova/lm-evaluation-harness has evidence coverage 1 captured evidence page."},{"subject":"sambanova/lm-evaluation-harness","predicate":"has captured page count","object":"1","text":"sambanova/lm-evaluation-harness has captured page count 1."},{"subject":"sambanova/lm-evaluation-harness","predicate":"has readable page count","object":"1","text":"sambanova/lm-evaluation-harness has readable page count 1."},{"subject":"sambanova/lm-evaluation-harness","predicate":"has related signal count","object":"1","text":"sambanova/lm-evaluation-harness has related signal count 1."},{"subject":"sambanova/lm-evaluation-harness","predicate":"has analysis playbook objective","object":"Turn fork activity into a map of upstream tools, libraries, model utilities, agent frameworks, and research dependencies being inspected or adapted.","text":"sambanova/lm-evaluation-harness has analysis playbook objective Turn fork activity into a map of upstream tools, libraries, model utilities, agent frameworks, and research dependencies being inspected or adapted.."},{"subject":"sambanova/lm-evaluation-harness","predicate":"has source host","object":"github.com","text":"sambanova/lm-evaluation-harness has source host github.com."},{"subject":"sambanova/lm-evaluation-harness","predicate":"has lab","object":"SambaNova Systems","text":"sambanova/lm-evaluation-harness has lab SambaNova Systems."},{"subject":"sambanova/lm-evaluation-harness","predicate":"has signal desk","object":"forks","text":"sambanova/lm-evaluation-harness has signal desk forks."},{"subject":"sambanova/lm-evaluation-harness","predicate":"has source host","object":"github.com","text":"sambanova/lm-evaluation-harness has source host github.com."},{"subject":"sambanova/lm-evaluation-harness","predicate":"has repository","object":"sambanova/lm-evaluation-harness","text":"sambanova/lm-evaluation-harness has repository sambanova/lm-evaluation-harness."},{"subject":"sambanova/lm-evaluation-harness","predicate":"has parent","object":"EleutherAI/lm-evaluation-harness","text":"sambanova/lm-evaluation-harness has parent EleutherAI/lm-evaluation-harness."},{"subject":"sambanova/lm-evaluation-harness","predicate":"has stars","object":"3","text":"sambanova/lm-evaluation-harness has stars 3."},{"subject":"sambanova/lm-evaluation-harness","predicate":"has watch term","object":"Eval methodology","text":"sambanova/lm-evaluation-harness has watch term Eval methodology."},{"subject":"sambanova/lm-evaluation-harness","predicate":"has watch term","object":"Model card","text":"sambanova/lm-evaluation-harness has watch term Model card."}]},"intelligence":{"signal_desk":"forks","answer":"SambaNova Systems forked sambanova/lm-evaluation-harness (forked from EleutherAI/lm-evaluation-harness). This fork signal points to upstream code the lab may be inspecting, patching, or building on. High-signal details: repo sambanova/lm-evaluation-harness · parent EleutherAI/lm-evaluation-harness. onlylabs links this event to 1 captured evidence page and 1 related fork signal.","semantic_triples":[{"subject":"SambaNova Systems","predicate":"forked","object":"sambanova/lm-evaluation-harness","text":"SambaNova Systems forked sambanova/lm-evaluation-harness."},{"subject":"sambanova/lm-evaluation-harness","predicate":"is classified as","object":"fork signal","text":"sambanova/lm-evaluation-harness is classified as fork signal."},{"subject":"sambanova/lm-evaluation-harness","predicate":"belongs to","object":"forks desk","text":"sambanova/lm-evaluation-harness belongs to forks desk."},{"subject":"sambanova/lm-evaluation-harness","predicate":"has context","object":"forked from EleutherAI/lm-evaluation-harness","text":"sambanova/lm-evaluation-harness has context forked from EleutherAI/lm-evaluation-harness."},{"subject":"sambanova/lm-evaluation-harness","predicate":"has evidence coverage","object":"1 captured evidence page","text":"sambanova/lm-evaluation-harness has evidence coverage 1 captured evidence page."}]},"signal":{"id":"6e9f1339-cb77-47c4-8165-d2d1a578c232","url":"https://onlylabs.fyi/signals/6e9f1339-cb77-47c4-8165-d2d1a578c232","json_url":"https://onlylabs.fyi/signals/6e9f1339-cb77-47c4-8165-d2d1a578c232/signal.json","source_url":"https://github.com/sambanova/lm-evaluation-harness","title":"sambanova/lm-evaluation-harness","summary":"SambaNova Systems forked upstream code. onlylabs watches forks for tooling, infrastructure, research dependencies, and product-adjacent work.","context":"forked from EleutherAI/lm-evaluation-harness","kind":{"key":"repo_forked","label":"Fork"},"org":{"slug":"sambanova","name":"SambaNova Systems","category":"neocloud"},"occurred_at":"2024-03-08T16:10:36+00:00","first_seen_at":"2026-06-05T22:32:07.650067+00:00","date_source":"source","evidence_coverage":{"target_pages":1,"captured_pages":1,"readable_pages":1,"capture_methods":["plain"],"missing_page_urls":[],"failed_page_urls":[],"blocked_page_urls":[],"page_urls":["https://github.com/sambanova/lm-evaluation-harness"]},"facets":{"repo":"sambanova/lm-evaluation-harness","parent":"EleutherAI/lm-evaluation-harness"},"traction":{"github_stars":3,"hn_points":null,"hn_comments":null,"hn_story_id":null,"hf_downloads":null,"hf_likes":null},"data_radar":null},"primary_evidence_page":{"url":"https://github.com/sambanova/lm-evaluation-harness","final_url":"https://github.com/sambanova/lm-evaluation-harness","title":"sambanova/lm-evaluation-harness repository metadata","http_status":200,"content_type":"application/json","capture_method":"plain","fetched_at":"2026-06-11T04:19:35.414643+00:00","bytes":46341,"raw_path":"b37e440b3799bcb0aecc31bd6d1d877257ee628e8ce85418ed4f89de25bf1380.json","content_hash":"5a4211ee7c262b221a7244adba171c0a45ab69970a9d09471deb881219d30cb5","excerpt_chars":1200,"truncated":true,"excerpt":"sambanova/lm-evaluation-harness Description: A framework for few-shot evaluation of language models. Language: Python License: MIT Stars: 3 Forks: 0 Open issues: 1 Created: 2024-03-08T16:10:36Z Pushed: 2024-05-17T20:08:23Z Default branch: main Fork: yes Parent repository: EleutherAI/lm-evaluation-harness Archived: no README: Language Model Evaluation Harness [![DOI](https://zenodo.org/badge/DOI/10.5281/zenodo.10256836.svg)](https://doi.org/10.5281/zenodo.10256836) Announcement **A new v0.4.0 release of lm-evaluation-harness is available** ! New updates and features include: - Internal refactoring - Config-based task creation and configuration - Easier import and sharing of externally-defined task config YAMLs - Support for Jinja2 prompt design, easy modification of prompts + prompt imports from Promptsource - More advanced configuration options, including output post-processing, answer extraction, and multiple LM generations per document, configurable fewshot settings, and more - Speedups and new modeling libraries supported, including: faster data-parallel HF model usage, vLLM support, MPS support with HuggingFace, and more - Logging and usability changes - New tasks including..."},"evidence_pages":[{"url":"https://github.com/sambanova/lm-evaluation-harness","final_url":"https://github.com/sambanova/lm-evaluation-harness","title":"sambanova/lm-evaluation-harness repository metadata","http_status":200,"content_type":"application/json","capture_method":"plain","fetched_at":"2026-06-11T04:19:35.414643+00:00","bytes":46341,"raw_path":"b37e440b3799bcb0aecc31bd6d1d877257ee628e8ce85418ed4f89de25bf1380.json","content_hash":"5a4211ee7c262b221a7244adba171c0a45ab69970a9d09471deb881219d30cb5","excerpt_chars":1200,"truncated":true,"excerpt":"sambanova/lm-evaluation-harness Description: A framework for few-shot evaluation of language models. Language: Python License: MIT Stars: 3 Forks: 0 Open issues: 1 Created: 2024-03-08T16:10:36Z Pushed: 2024-05-17T20:08:23Z Default branch: main Fork: yes Parent repository: EleutherAI/lm-evaluation-harness Archived: no README: Language Model Evaluation Harness [![DOI](https://zenodo.org/badge/DOI/10.5281/zenodo.10256836.svg)](https://doi.org/10.5281/zenodo.10256836) Announcement **A new v0.4.0 release of lm-evaluation-harness is available** ! New updates and features include: - Internal refactoring - Config-based task creation and configuration - Easier import and sharing of externally-defined task config YAMLs - Support for Jinja2 prompt design, easy modification of prompts + prompt imports from Promptsource - More advanced configuration options, including output post-processing, answer extraction, and multiple LM generations per document, configurable fewshot settings, and more - Speedups and new modeling libraries supported, including: faster data-parallel HF model usage, vLLM support, MPS support with HuggingFace, and more - Logging and usability changes - New tasks including..."}],"related_signals":[{"id":"37bad421-a19e-42d9-ad71-4a1765adea87","url":"https://onlylabs.fyi/signals/37bad421-a19e-42d9-ad71-4a1765adea87","source_url":"https://github.com/sambanova/transformers","title":"sambanova/transformers","context":"forked from huggingface/transformers","kind":{"key":"repo_forked","label":"Fork"},"org":{"slug":"sambanova","name":"SambaNova Systems","category":"neocloud"},"occurred_at":"2024-04-03T20:27:54+00:00","first_seen_at":"2026-06-05T22:32:07.650067+00:00","date_source":"source"}]}