[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"article-proper-positive-only-learning-characterization-en":3,"article-related-proper-positive-only-learning-characterization-en":30,"series-research-2ae76231-ec2d-48aa-a82f-1d26f1b36882":73},{"id":4,"slug":5,"title":6,"content":7,"summary":8,"source":9,"source_url":10,"author":11,"image_url":12,"cover_image":12,"category":13,"language":14,"translated_content":11,"related_article_id":15,"keywords":16,"key_takeaways":22,"views":26,"created_at":27,"published_at":28,"topic_cluster_id":29},"2ae76231-ec2d-48aa-a82f-1d26f1b36882","proper-positive-only-learning-characterization-en","Proper positive-only learning gets a full characterization","\u003Cp data-speakable=\"summary\">A new result characterizes when proper learning from positive-only samples is possible.\u003C\u002Fp>\u003Cul>\u003Cli>\u003Cstrong>Research org\u003C\u002Fstrong>: Unspecified in arXiv abstract\u003C\u002Fli>\u003Cli>\u003Cstrong>Core data\u003C\u002Fstrong>: No benchmark numbers in abstract\u003C\u002Fli>\u003Cli>\u003Cstrong>Breakthrough\u003C\u002Fstrong>: Finite VC dimension plus uniform exterior separability\u003C\u002Fli>\u003C\u002Ful>\u003Cp>Positive-only learning sounds simple, but it hides a nasty twist: the learner only sees examples from the positive region, while evaluation still happens on the full original distribution. That makes the problem very different from standard PAC learning, and it has been open for decades in the proper-learning setting.\u003C\u002Fp>\u003Cp>This paper closes that gap. The authors give a clean characterization of when proper positive-only learning is possible, and the answer is not just “finite VC dimension.” They show that you also need a new combinatorial property they call uniform exterior separability.\u003C\u002Fp>\u003Ch2>What problem this paper is trying to fix\u003C\u002Fh2>\u003Cp>In ordinary binary classification, a learner gets labeled examples from both classes. In positive-only learning, the learner only receives i.i.d. samples from the positive region of the target concept. That means the training data is biased by construction: you never directly observe negative examples, even though the final predictor is judged against the original distribution that includes both positive and negative mass.\u003C\u002Fp>\n\u003Cfigure class=\"my-6\">\u003Cimg src=\"https:\u002F\u002Fxxdpdyhzhpamafnrdkyq.supabase.co\u002Fstorage\u002Fv1\u002Fobject\u002Fpublic\u002Fcovers\u002Finline-1782713877346-qgit.png\" alt=\"Proper positive-only learning gets a full characterization\" class=\"rounded-xl w-full\" loading=\"lazy\" \u002F>\u003C\u002Ffigure>\n\u003Cp>This model goes back to Natarajan’s 1987 STOC work, and the improper-learning story is already well understood. But the proper-learning case — where the learned hypothesis must belong to the same concept class as the target — had remained unresolved. The paper is about that missing piece.\u003C\u002Fp>\u003Cp>For engineers, the practical lesson is that “learning from positives only” is not just a data sparsity issue. It changes the geometry of the learning problem itself. Some concept classes that look manageable under standard PAC assumptions stop being learnable once you require proper learning from positive-only samples.\u003C\u002Fp>\u003Ch2>How the method works in plain English\u003C\u002Fh2>\u003Cp>The authors revisit the problem through the lens of combinatorial characterization. Their main result says a concept class is properly learnable from positive-only samples if and only if two conditions hold: the class has finite VC dimension, and it satisfies uniform exterior separability.\u003C\u002Fp>\u003Cp>VC dimension is familiar territory for anyone who has worked with statistical learning theory. It measures how expressive a class is. The new part is uniform exterior separability, which is the extra structural constraint needed to make proper positive-only learning work. The abstract does not spell out the full formal definition, but the key point is that this property captures something about how a class behaves outside the positive region.\u003C\u002Fp>\u003Cp>They also introduce new combinatorial dimensions along the way. The abstract does not list them by name or define them in detail, but it does say they may be of broader interest in learning theory. That suggests the paper is not only answering an old question, but also adding tools for analyzing related learning models.\u003C\u002Fp>\u003Ch2>What the paper actually shows\u003C\u002Fh2>\u003Cp>The headline result is an “if and only if” characterization. That matters because it turns a vague open question into a precise boundary: proper positive-only learning is possible exactly when both conditions are met. In other words, finite VC dimension alone is not enough.\u003C\u002Fp>\n\u003Cfigure class=\"my-6\">\u003Cimg src=\"https:\u002F\u002Fxxdpdyhzhpamafnrdkyq.supabase.co\u002Fstorage\u002Fv1\u002Fobject\u002Fpublic\u002Fcovers\u002Finline-1782713878099-nzi5.png\" alt=\"Proper positive-only learning gets a full characterization\" class=\"rounded-xl w-full\" loading=\"lazy\" \u002F>\u003C\u002Ffigure>\n\u003Cp>The paper also reports several separation results, and these are where the landscape gets interesting. Proper and improper learning are separated. Randomized and deterministic proper learning are separated. There are concept classes for which no empirical risk minimizer, or ERM, is a learner. And even finite VC dimension does not guarantee non-uniform learnability in this setting.\u003C\u002Fp>\u003Cp>Those separations are important because they show the positive-only model is not just a small variant of standard PAC learning. It has its own failure modes and its own hierarchy of learnability notions. If you assumed the usual intuition from standard classification would carry over, this paper says it does not.\u003C\u002Fp>\u003Cp>One thing the abstract does not provide is \u003Ca href=\"\u002Ftag\u002Fbenchmark\">benchmark\u003C\u002Fa> numbers. There are no accuracy percentages, sample complexity tables, or runtime measurements to compare. This is a theory paper, so the value is in the characterization and the separation results rather than empirical performance.\u003C\u002Fp>\u003Ch2>Why developers and ML practitioners should care\u003C\u002Fh2>\u003Cp>If you build systems where you only observe positives — for example, cases where negatives are unlabeled, missing, or too expensive to collect — this paper is a reminder that the learning setup itself can block you before optimization even starts. The right question is not only “can my model fit the data?” but also “is my hypothesis class learnable under this feedback model?”\u003C\u002Fp>\u003Cp>That distinction matters for model selection. A class that is fine under standard supervised learning may fail under positive-only supervision if it lacks uniform exterior separability. In practical terms, this means you may need to rethink the hypothesis class, not just the training procedure.\u003C\u002Fp>\u003Cp>The paper also gives theory practitioners a sharper map of the space. By separating proper from improper learning, and randomized from deterministic proper learning, it shows there are multiple layers of difficulty hiding under the same positive-only label. That can guide future work on weak supervision, one-class-style settings, and other regimes where the training signal is incomplete.\u003C\u002Fp>\u003Ch2>Limitations and open questions\u003C\u002Fh2>\u003Cp>The abstract is clear about what is proven, but it does not give algorithmic details, sample complexity bounds, or implementation guidance. So while the characterization is mathematically complete, it does not immediately translate into a recipe for production systems.\u003C\u002Fp>\u003Cp>It is also worth noting that the result is about concept classes in the PAC framework. If your problem is noisy, non-i.i.d., or involves richer supervision signals, the theorem may not apply directly. The paper’s contribution is foundational, not a plug-and-play method.\u003C\u002Fp>\u003Cul>\u003Cli>Proper positive-only learning has a complete characterization in terms of VC dimension and uniform exterior separability.\u003C\u002Fli>\u003Cli>The positive-only setting behaves differently from standard PAC learning, with separations between several learning notions.\u003C\u002Fli>\u003Cli>The paper is theoretical and does not report benchmark numbers or empirical results in the abstract.\u003C\u002Fli>\u003C\u002Ful>\u003Cp>For anyone working on learning from incomplete labels, the main takeaway is simple: positive-only data can be fundamentally more restrictive than it looks. This paper pins down exactly when proper learning survives that restriction, and when it does not.\u003C\u002Fp>","A new result characterizes when proper learning from positive-only samples is possible.","arxiv.org","https:\u002F\u002Farxiv.org\u002Fabs\u002F2606.28309",null,"https:\u002F\u002Fxxdpdyhzhpamafnrdkyq.supabase.co\u002Fstorage\u002Fv1\u002Fobject\u002Fpublic\u002Fcovers\u002Finline-1782713877346-qgit.png","research","en","f303e5bb-372c-48f6-bfc3-f7a73a1e678b",[17,18,19,20,21],"positive-only learning","PAC learning","VC dimension","proper learning","combinatorial characterization",[23,24,25],"Proper positive-only learning is characterized by finite VC dimension plus uniform exterior separability.","The model exhibits separations between proper and improper learning, and between randomized and deterministic proper learning.","The abstract provides no benchmark numbers; the contribution is a theoretical characterization and separation results.",0,"2026-06-29T06:17:34.38343+00:00","2026-06-29T06:17:34.369+00:00","3103988e-c4fe-45e3-98ab-846500c9d507",{"tags":31,"relatedLang":32,"relatedPosts":36},[],{"id":15,"slug":33,"title":34,"language":35},"proper-positive-only-learning-characterization-zh","正向樣本學習的完整界線","zh",[37,43,49,55,61,67],{"id":38,"slug":39,"title":40,"cover_image":41,"image_url":41,"created_at":42,"category":13},"f3edd37b-2524-4d6d-b411-7ca0cce9eff0","google-deepmind-turns-science-into-tools-en","Google DeepMind turns science into tools","https:\u002F\u002Fxxdpdyhzhpamafnrdkyq.supabase.co\u002Fstorage\u002Fv1\u002Fobject\u002Fpublic\u002Fcovers\u002Finline-1782721105101-d4rm.png","2026-06-29T08:17:58.280652+00:00",{"id":44,"slug":45,"title":46,"cover_image":47,"image_url":47,"created_at":48,"category":13},"c522f9af-2862-4f1c-bbf9-99bc20c78544","measuring-llm-behavior-portability-en","Measuring when LLM behavior actually переносится","https:\u002F\u002Fxxdpdyhzhpamafnrdkyq.supabase.co\u002Fstorage\u002Fv1\u002Fobject\u002Fpublic\u002Fcovers\u002Finline-1782717476648-9gjo.png","2026-06-29T07:17:30.115953+00:00",{"id":50,"slug":51,"title":52,"cover_image":53,"image_url":53,"created_at":54,"category":13},"1a5d9d4d-4e21-4860-84b0-9b209ca4d7f5","prompt-injection-ai-security-problem-en","Prompt injection is now an AI security problem","https:\u002F\u002Fxxdpdyhzhpamafnrdkyq.supabase.co\u002Fstorage\u002Fv1\u002Fobject\u002Fpublic\u002Fcovers\u002Finline-1782716584463-r1ei.png","2026-06-29T07:02:36.642691+00:00",{"id":56,"slug":57,"title":58,"cover_image":59,"image_url":59,"created_at":60,"category":13},"fba917c8-939c-4457-a90e-4012d9a692df","solver-choice-nash-equilibrium-selection-en","Solver choice changes which Nash equilibrium wins","https:\u002F\u002Fxxdpdyhzhpamafnrdkyq.supabase.co\u002Fstorage\u002Fv1\u002Fobject\u002Fpublic\u002Fcovers\u002Finline-1782714784738-e4dj.png","2026-06-29T06:32:31.603116+00:00",{"id":62,"slug":63,"title":64,"cover_image":65,"image_url":65,"created_at":66,"category":13},"46714aa0-3c43-4154-a9cf-f961865b6109","dexcompose-reuses-dexterous-policies-across-tasks-en","DexCompose Reuses Dexterous Policies Across Tasks","https:\u002F\u002Fxxdpdyhzhpamafnrdkyq.supabase.co\u002Fstorage\u002Fv1\u002Fobject\u002Fpublic\u002Fcovers\u002Finline-1782712971902-lykf.png","2026-06-29T06:02:28.7043+00:00",{"id":68,"slug":69,"title":70,"cover_image":71,"image_url":71,"created_at":72,"category":13},"ce859659-0b28-456b-8641-63f6d4c47cf9","hawor-hand-motion-mano-params-en","HaWoR turns hand motion into MANO params","https:\u002F\u002Fxxdpdyhzhpamafnrdkyq.supabase.co\u002Fstorage\u002Fv1\u002Fobject\u002Fpublic\u002Fcovers\u002Finline-1782705791981-evnj.png","2026-06-29T04:02:46.964681+00:00",[74,79,84,89,94,99,104,109,114,119],{"id":75,"slug":76,"title":77,"created_at":78},"a2715e72-1fe8-41b3-abb1-d0cf1f710189","ai-predictions-2026-big-changes-en","AI Predictions for 2026: Brace for Big Changes","2026-03-26T01:25:07.788356+00:00",{"id":80,"slug":81,"title":82,"created_at":83},"8404bd7b-4c2f-4109-9ec4-baf29d88af2b","ml-papers-of-the-week-github-research-desk-en","ML Papers of the Week Turns GitHub Into a Research Desk","2026-03-27T01:11:39.480259+00:00",{"id":85,"slug":86,"title":87,"created_at":88},"87897a94-8065-4464-a016-1f23e89e17cc","ai-ml-conferences-to-watch-in-2026-en","AI\u002FML Conferences to Watch in 2026","2026-03-27T01:51:54.184108+00:00",{"id":90,"slug":91,"title":92,"created_at":93},"6f1987cf-25f3-47a4-b3e6-db0997695be8","openclaw-agents-manipulated-self-sabotage-en","OpenClaw Agents Can Be Manipulated Into Failure","2026-03-28T03:03:18.899465+00:00",{"id":95,"slug":96,"title":97,"created_at":98},"a53571ad-735a-4178-9f93-cb09b699d99c","vega-driving-language-instructions-en","Vega: Driving with Natural Language Instructions","2026-03-28T14:54:04.698882+00:00",{"id":100,"slug":101,"title":102,"created_at":103},"a34581d6-f36e-46da-88bb-582fb3e7425c","personalizing-autonomous-driving-styles-en","Drive My Way: Personalizing Autonomous Driving Styles","2026-03-28T14:54:26.148181+00:00",{"id":105,"slug":106,"title":107,"created_at":108},"2bc1ad7f-26ce-4f02-9885-803b35fd229d","training-knowledge-bases-writeback-rag-en","Training Knowledge Bases with WriteBack-RAG","2026-03-28T14:54:45.643433+00:00",{"id":110,"slug":111,"title":112,"created_at":113},"71adc507-3c54-4605-bbe2-c966acd6187e","packforcing-long-video-generation-en","PackForcing: Efficient Long-Video Generation Method","2026-03-28T14:55:02.646943+00:00",{"id":115,"slug":116,"title":117,"created_at":118},"675942ef-b9ec-4c5f-a997-381250b6eacb","pixelsmile-facial-expression-editing-en","PixelSmile Framework Enhances Facial Expression Editing","2026-03-28T14:55:20.633463+00:00",{"id":120,"slug":121,"title":122,"created_at":123},"6954fa2b-8b66-4839-884b-e46f89fa1bc3","adaptive-block-scaled-data-types-en","IF4: Smarter 4-Bit Quantization That Adapts to Your Data","2026-03-31T06:00:36.65963+00:00"]