Accessibility Statement Skip Navigation
  • Resources
  • Investor Relations
  • Journalists
  • Agencies
  • Client Login
  • Send a Release
Return to PR Newswire homepage
  • News
  • Products
  • Contact
Search
When typing in this field, a list of search results will appear and be automatically updated as you type.

Searching for your content...

No results found. Please change your search terms and try again.
  • News Releases view all

    • News in Focus
        • Browse News Releases

        • All News Releases
        • All Public Company
        • English-only
        • News Releases Overview

        • Multimedia Gallery

        • All Multimedia
        • All Photos
        • All Videos
        • Multimedia Gallery Overview

        • Trending Topics

        • All Trending Topics
    • Business & Money
        • Auto & Transportation

        • Aerospace, Defense
        • Air Freight
        • Airlines & Aviation
        • Automotive
        • Maritime & Shipbuilding
        • Railroads and Intermodal Transportation
        • Supply Chain/Logistics
        • Transportation, Trucking & Railroad
        • Travel
        • Trucking and Road Transportation
        • Auto & Transportation Overview

        • View All Auto & Transportation

        • Business Technology

        • Blockchain
        • Broadcast Tech
        • Computer & Electronics
        • Computer Hardware
        • Computer Software
        • Data Analytics
        • Electronic Commerce
        • Electronic Components
        • Electronic Design Automation
        • Financial Technology
        • High Tech Security
        • Internet Technology
        • Nanotechnology
        • Networks
        • Peripherals
        • Semiconductors
        • Business Technology Overview

        • View All Business Technology

        • Entertain­ment & Media

        • Advertising
        • Art
        • Books
        • Entertainment
        • Film and Motion Picture
        • Magazines
        • Music
        • Publishing & Information Services
        • Radio & Podcast
        • Television
        • Entertainment & Media Overview

        • View All Entertain­ment & Media

        • Financial Services & Investing

        • Accounting News & Issues
        • Acquisitions, Mergers and Takeovers
        • Banking & Financial Services
        • Bankruptcy
        • Bond & Stock Ratings
        • Conference Call Announcements
        • Contracts
        • Cryptocurrency
        • Dividends
        • Earnings
        • Earnings Forecasts & Projections
        • Financing Agreements
        • Insurance
        • Investments Opinions
        • Joint Ventures
        • Mutual Funds
        • Private Placement
        • Real Estate
        • Restructuring & Recapitalization
        • Sales Reports
        • Shareholder Activism
        • Shareholder Meetings
        • Stock Offering
        • Stock Split
        • Venture Capital
        • Financial Services & Investing Overview

        • View All Financial Services & Investing

        • General Business

        • Awards
        • Commercial Real Estate
        • Corporate Expansion
        • Earnings
        • Environmental, Social and Governance (ESG)
        • Human Resource & Workforce Management
        • Licensing
        • New Products & Services
        • Obituaries
        • Outsourcing Businesses
        • Overseas Real Estate (non-US)
        • Personnel Announcements
        • Real Estate Transactions
        • Residential Real Estate
        • Small Business Services
        • Socially Responsible Investing
        • Surveys, Polls and Research
        • Trade Show News
        • General Business Overview

        • View All General Business

    • Science & Tech
        • Consumer Technology

        • Artificial Intelligence
        • Blockchain
        • Cloud Computing/Internet of Things
        • Computer Electronics
        • Computer Hardware
        • Computer Software
        • Consumer Electronics
        • Cryptocurrency
        • Data Analytics
        • Electronic Commerce
        • Electronic Gaming
        • Financial Technology
        • Mobile Entertainment
        • Multimedia & Internet
        • Peripherals
        • Social Media
        • STEM (Science, Tech, Engineering, Math)
        • Supply Chain/Logistics
        • Wireless Communications
        • Consumer Technology Overview

        • View All Consumer Technology

        • Energy & Natural Resources

        • Alternative Energies
        • Chemical
        • Electrical Utilities
        • Gas
        • General Manufacturing
        • Mining
        • Mining & Metals
        • Oil & Energy
        • Oil and Gas Discoveries
        • Utilities
        • Water Utilities
        • Energy & Natural Resources Overview

        • View All Energy & Natural Resources

        • Environ­ment

        • Conservation & Recycling
        • Environmental Issues
        • Environmental Policy
        • Environmental Products & Services
        • Green Technology
        • Natural Disasters
        • Environment Overview

        • View All Environ­ment

        • Heavy Industry & Manufacturing

        • Aerospace & Defense
        • Agriculture
        • Chemical
        • Construction & Building
        • General Manufacturing
        • HVAC (Heating, Ventilation and Air-Conditioning)
        • Machinery
        • Machine Tools, Metalworking and Metallurgy
        • Mining
        • Mining & Metals
        • Paper, Forest Products & Containers
        • Precious Metals
        • Textiles
        • Tobacco
        • Heavy Industry & Manufacturing Overview

        • View All Heavy Industry & Manufacturing

        • Telecomm­unications

        • Carriers and Services
        • Mobile Entertainment
        • Networks
        • Peripherals
        • Telecommunications Equipment
        • Telecommunications Industry
        • VoIP (Voice over Internet Protocol)
        • Wireless Communications
        • Telecommunications Overview

        • View All Telecomm­unications

    • Lifestyle & Health
        • Consumer Products & Retail

        • Animals & Pets
        • Beers, Wines and Spirits
        • Beverages
        • Bridal Services
        • Cannabis
        • Cosmetics and Personal Care
        • Fashion
        • Food & Beverages
        • Furniture and Furnishings
        • Home Improvement
        • Household, Consumer & Cosmetics
        • Household Products
        • Jewelry
        • Non-Alcoholic Beverages
        • Office Products
        • Organic Food
        • Product Recalls
        • Restaurants
        • Retail
        • Supermarkets
        • Toys
        • Consumer Products & Retail Overview

        • View All Consumer Products & Retail

        • Entertain­ment & Media

        • Advertising
        • Art
        • Books
        • Entertainment
        • Film and Motion Picture
        • Magazines
        • Music
        • Publishing & Information Services
        • Radio & Podcast
        • Television
        • Entertainment & Media Overview

        • View All Entertain­ment & Media

        • Health

        • Biometrics
        • Biotechnology
        • Clinical Trials & Medical Discoveries
        • Dentistry
        • FDA Approval
        • Fitness/Wellness
        • Health Care & Hospitals
        • Health Insurance
        • Infection Control
        • International Medical Approval
        • Medical Equipment
        • Medical Pharmaceuticals
        • Mental Health
        • Pharmaceuticals
        • Supplementary Medicine
        • Health Overview

        • View All Health

        • Sports

        • General Sports
        • Outdoors, Camping & Hiking
        • Sporting Events
        • Sports Equipment & Accessories
        • Sports Overview

        • View All Sports

        • Travel

        • Amusement Parks and Tourist Attractions
        • Gambling & Casinos
        • Hotels and Resorts
        • Leisure & Tourism
        • Outdoors, Camping & Hiking
        • Passenger Aviation
        • Travel Industry
        • Travel Overview

        • View All Travel

    • Policy & Public Interest
        • Policy & Public Interest

        • Advocacy Group Opinion
        • Animal Welfare
        • Congressional & Presidential Campaigns
        • Corporate Social Responsibility
        • Domestic Policy
        • Economic News, Trends, Analysis
        • Education
        • Environmental
        • European Government
        • FDA Approval
        • Federal and State Legislation
        • Federal Executive Branch & Agency
        • Foreign Policy & International Affairs
        • Homeland Security
        • Labor & Union
        • Legal Issues
        • Natural Disasters
        • Not For Profit
        • Patent Law
        • Public Safety
        • Trade Policy
        • U.S. State Policy
        • Policy & Public Interest Overview

        • View All Policy & Public Interest

    • People & Culture
        • People & Culture

        • Aboriginal, First Nations & Native American
        • African American
        • Asian American
        • Children
        • Diversity, Equity & Inclusion
        • Hispanic
        • Lesbian, Gay & Bisexual
        • Men's Interest
        • People with Disabilities
        • Religion
        • Senior Citizens
        • Veterans
        • Women
        • People & Culture Overview

        • View All People & Culture

    • Explore Our Platform
    • Plan Campaigns
    • Create with AI
    • Distribute Press Releases
    • Report Results
    • Amplify Content
    • All Products
    • General Inquiries
    • Editorial Bureaus
    • Partnerships
    • Media Inquiries
    • Worldwide Offices
    • Hamburger menu
    • PR Newswire: news distribution, targeting and monitoring
    • Send a Release
      • ALL CONTACT INFO
      • Contact Us

        888-776-0942
        from 8 AM - 10 PM ET

    • Searching for your content...

      No results found. Please change your search terms and try again.

      News Releases

      view all
      Close menu
    • News
    • Products
    • Contact
      • Send a Release
      • Client Login
      • Resources
      • Blog
      • Journalists
      • RSS
      • 3 News in Focus
      • 5 Business & Money
      • 5 Science & Tech
      • 5 Lifestyle & Health
      • 1 Policy & Public Interest
      • 1 People & Culture
      • Send a Release
      • Client Login
      • Resources
      • Blog
      • Journalists
      • RSS
      • Explore Our Platform
      • Plan Campaigns
      • Create with AI
      • Distribute Press Releases
      • Report Results
      • Amplify Content
      • All Products
      • Send a Release
      • Client Login
      • Resources
      • Blog
      • Journalists
      • RSS
      • General Inquiries
      • Editorial Bureaus
      • Partnerships
      • Media Inquiries
      • Worldwide Offices
      • Send a Release
      • Client Login
      • Resources
      • Blog
      • Journalists
      • RSS
      Close submenu (News in Focus) News in Focus
      • Browse News Releases
      • Multimedia Gallery
      • Trending Topics
      Close submenu (Business & Money) Business & Money
      • Auto & Transportation
      • Business Technology
      • Entertain­ment & Media
      • Financial Services & Investing
      • General Business
      Close submenu (Science & Tech) Science & Tech
      • Consumer Technology
      • Energy & Natural Resources
      • Environ­ment
      • Heavy Industry & Manufacturing
      • Telecomm­unications
      Close submenu (Lifestyle & Health) Lifestyle & Health
      • Consumer Products & Retail
      • Entertain­ment & Media
      • Health
      • Sports
      • Travel
      Close submenu (Policy & Public Interest) Policy & Public Interest
      • Policy & Public Interest
      Close submenu (People & Culture) People & Culture
      • People & Culture

      Einsia AI Launches Visual Cipher Bench to Evaluate Long-Horizon Visual Reasoning in AI Agents


      News provided by

      Einsia AI Technology (SG) PTE. LTD.

      Nov 18, 2026, 05:39 ET

      Share this article

      Share this article


      Top-performing model achieves just 26.7% accuracy, revealing a significant gap in autonomous rule discovery

      SINGAPORE, Nov. 18, 2026 /PRNewswire/ -- As AI agents evolve from answering questions to completing complex tasks, a fundamental challenge remains: Can they solve problems when instructions are absent and rules must be discovered entirely from visual clues?

      Einsia AI's Navers Lab today announced Visual Cipher Bench, a new benchmark evaluating long-horizon visual reasoning in AI agents, focusing on rule discovery, logical planning, and spatial operations.

      Continue Reading
      Figure 1: Overview of Visual Cipher Bench. Left: 40 original puzzles (67 images) in four categories. Middle: each model's best configuration, averaged over three runs. Right: the evaluation pipeline, from puzzle images to a single scored answer.
      Figure 1: Overview of Visual Cipher Bench. Left: 40 original puzzles (67 images) in four categories. Middle: each model's best configuration, averaged over three runs. Right: the evaluation pipeline, from puzzle images to a single scored answer.
      Figure 2: Accuracy (%) of the eight evaluated models. Each bar is one reasoning-effort setting, from lowest to highest; the number shown is the model's best configuration.
      Figure 2: Accuracy (%) of the eight evaluated models. Each bar is one reasoning-effort setting, from lowest to highest; the number shown is the model's best configuration.
      Figure 3: Full results for all 29 model–effort configurations, with accuracy by category and overall. Shaded rows mark each model's best configuration.
      Figure 3: Full results for all 29 model–effort configurations, with accuracy by category and overall. Shaded rows mark each model's best configuration.
      Figure 4: Hint experiment on 10 puzzles with three models. A one-sentence mechanism hint raises overall accuracy from 12.2% to 51.1%, and rule induction from 0% to 85.2%.
      Figure 4: Hint experiment on 10 puzzles with three models. A one-sentence mechanism hint raises overall accuracy from 12.2% to 51.1%, and rule induction from 0% to 85.2%.

      Across eight frontier models and 29 reasoning configurations, the benchmark recorded 3,480 attempts. No configuration achieved accuracy above 30%. The top performer, GPT-6 Astra (max), scored 26.7%. DeepSeek V4.1 Flash, Qwen 3.8 Max, and Kimi K3.1 Pro failed to solve any puzzles.

      The findings expose a critical gap between executing known instructions and independently discovering unknown rules. While spatial reasoning proved relatively manageable, accuracy on rule induction was just 0.6%.

      Testing AI Beyond Conventional Visual Question Answering

      Unlike conventional visual benchmarks, which typically provide explicit questions and expected answers, Visual Cipher Bench tests scenarios where instructions are hidden in images, with no explicit rules or immediate correctness feedback.

      The benchmark comprises 40 original visual puzzles represented by 67 black-and-white illustrations. Agents receive one instruction: examine the images and write the final answer to a file. They must independently identify examples, understand the target problem, infer the required output, and solve each task.

      The puzzles cover four categories:

      • Spatial Operations: Folding, rotation, projection, and geometric transformations.
      • Logical Planning: Extracting visual constraints and finding valid solutions.
      • Rule Induction: Discovering hidden patterns from limited examples.
      • Knowledge Decoding: Interpreting Morse code, Braille, and word puzzles.

      Frontier Models Struggle with Autonomous Rule Discovery

      Performance varied significantly across the eight evaluated models:

      • GPT-6 Astra (max): 26.7%, averaging 10.7 correct answers per 40-puzzle run.
      • GPT-6.1 Sol (max) and Claude Opus 5.5 (xhigh): Both scored 21.7%.
      • GPT-6 Luna and Claude Sonnet 5.5: Both scored 0.8%, solving one puzzle each across 120 attempts.
      • DeepSeek V4.1 Flash, Qwen 3.8 Max, and Kimi K3.1 Pro: Zero correct answers.

      Across all 3,480 attempts, accuracy by category was:

      • Spatial Operations: 22.8%
      • Knowledge Decoding: 3.3%
      • Logical Planning: 2.4%
      • Rule Induction: 0.6%

      Models solved only five of 870 rule-induction attempts. Even GPT-6 Astra (max) achieved 80% on spatial operations, while no configuration exceeded 13.3% in the other three categories. Researchers also found that some correct answers resulted from thematic guesses rather than systematic rule discovery.

      Providing Rules Raises Accuracy from 12.2% to 51.1%

      To distinguish rule discovery from rule execution, researchers conducted an additional experiment on 10 puzzles using GPT-6 Astra, GPT-6.1 Sol, and GPT-6 Luna.

      When provided with the core rules—but not intermediate reasoning steps or answers—overall accuracy increased from 12.2% to 51.1%. Rule-induction accuracy rose from 0% to 85.2%.

      GPT-6 Astra improved from 23.3% to 70.0%, while GPT-6.1 Sol increased from 13.3% to 66.7%. Timeout occurrences also fell from 51 to 29 across 90 attempts.

      A control experiment providing additional information about task-state representation, but not the core rules, achieved only 16.7% accuracy. Even with rule hints, logical planning accuracy remained at 22.2%.

      Why Do AI Agents Fail?

      Analysis of failure trajectories revealed two recurring patterns.

      Premature conclusions: Agents often adopted rules that explained only some examples without validating them against all available evidence. Some submitted answers despite acknowledging incomplete understanding.

      Inefficient search: Agents frequently relied on extensive tool calls and exhaustive combinations instead of using visual constraints to narrow the search space, eventually timing out.

      More effective reasoning involved generating multiple hypotheses, testing them against examples, eliminating inconsistent rules, and applying the remaining valid hypothesis.

      From Following Instructions to Discovering Rules

      In software development, agents typically receive explicit requirements and can rely on test results to evaluate their solutions. Real-world problems often provide neither.

      Agents must observe their environment, identify relevant signals, formulate hypotheses, and validate their understanding without explicit instructions or immediate feedback.

      Visual Cipher Bench provides a systematic evaluation of this capability gap. Its findings suggest that independently discovering, validating, and transferring hidden rules remains a significant challenge for frontier AI agents —a capability increasingly important as AI moves toward more autonomous problem-solving.

      Research and Resources

      • Paper: Visual Cipher Bench: Benchmarking LLM Agents on Long-Horizon Visual Reasoning
      • Project Website: https://lab.einsia.ai/visual-cipher-bench/
      • Research Paper: https://arxiv.org/abs/2611.16861
      • GitHub: https://github.com/Einsia/Visual-Cipher-Bench

      SOURCE Einsia AI Technology (SG) PTE. LTD.

      Modal title

      Contact PR Newswire

      • Call PR Newswire at 888-776-0942
        from 8 AM - 9 PM ET
      • Chat with an Expert
      • General Inquiries
      • Editorial Bureaus
      • Partnerships
      • Media Inquiries
      • Worldwide Offices

      Products

      • Explore Our Platform
      • Plan Campaigns
      • Create with AI
      • Distribute Press Releases
      • Report Results
      • Amplify Content

      About

      • About PR Newswire
      • About Cision
      • Careers
      • Accessibility Statement
      • APAC
      • APAC - Simplified Chinese
      • APAC - Traditional Chinese
      • Brazil
      • Canada
      • Czech
      • Denmark
      • Finland
      • France
      • Germany
      • India
      • Indonesia
      • Israel
      • Italy
      • Japan
      • Korea
      • Mexico
      • Middle East
      • Middle East - Arabic
      • Netherlands
      • Norway
      • Poland
      • Portugal
      • Russia
      • Slovakia
      • Spain
      • Sweden
      • United Kingdom
      • Vietnam

      My Services

      • All New Releases
      • Platform Login
      • Data Privacy

      Do not sell or share my personal information:

      • Submit via [email protected] 
      • Call Privacy toll-free: 877-297-8921

      Contact PR Newswire

      Products

      About

      My Services
      • All News Releases
      • Platform Login
      • ProfNet
      Call PR Newswire at
      888-776-0942
      • Terms of Use
      • Privacy Policy
      • Information Security Policy
      • Site Map
      • RSS
      • Cookies
      Copyright © 2026 Cision US Inc.