framework
active
framework:atlas-agentic-or-latent-visual-reasoningATLAS: Agentic or Latent Visual Reasoning
Core framework proposing discrete functional tokens as a unified solution for visual reasoning in VLMs, bridging agentic and latent approaches.
Neighborhood — ranked by edge-count
Thinkers (4)
thinker
- Pheng-Ann HengauthoredCo-author of ATLAS paper, affiliated with CUHK.
- Rain LiuauthoredCo-author of ATLAS paper, affiliated with Meta AI.
- Xinyan ChenauthoredCo-author of ATLAS paper, affiliated with CUHK.
- Ziyu GuoauthoredLead author of ATLAS paper, affiliated with Meta AI and CUHK.
Methods (1)
method
- Latent-Anchored GRPO (LA-GRPO)implementsToken-level auxiliary objective that strengthens optimization of sparse functional tokens during RL by anchoring group-level advantages directly to functional-token positions.
Concepts (4)
concept
- Qwen2.5-VL-7BimplementsBase vision-language model used to instantiate ATLAS.
- Agentic Visual Reasoningassociated_withParadigm where VLM acts as controller generating code or tool calls to external modules for visual operations, incurring context-switching latency.
- Functional TokenimplementsA discrete token in the vocabulary that represents a visual operation (e.g., <|Line|>, <|Shape|>, <|Text|>), generated via next-token prediction within autoregressive sequences.
- Unified Models Generate Intermediate Imagesassociated_withParadigm where VLMs explicitly generate pixel-level intermediate images for visual reasoning, incurring high computational overhead.
Datasets (4)
dataset
- ATLAS-178KcitesCurated SFT dataset with 178K examples covering 40+ visual reasoning tasks, annotated with functional-token trajectories to provide supervised training signal.
- BLINKcitesEvaluation benchmark for visual reasoning tasks used to assess ATLAS performance.
- V*citesEvaluation benchmark for visual reasoning used to assess ATLAS performance.
- WeMathcitesEvaluation benchmark for mathematical visual reasoning used to assess ATLAS performance.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Core claim of the paper: a unified token bridges the gaps.
- The paper's thesis from the title.
- Vector-based navigation using grid-like representations in artificial agents (Banino et al., 2018)concept0.768Demonstrated grid cell emergence in RNNs trained on spatial navigation; related work category 4.
- Reasoning approach using learnable hidden embeddings.
- Reasoning approach using code or tool calls executed by an agent.
- Statement of existing alternatives to direct generation.
- Visual reasoning tasks often interleaved with intermediate visual states; promising direction in the field.
- Core idea of ATLAS: a single discrete token serves dual purpose of operation specification and latent reasoning.