Datasets:
id string | images images list | n_images int32 | image_sizes list | image_phashes list | category string | source_subset string | categories list | sources list | source_subsets list | data list |
|---|---|---|---|---|---|---|---|---|---|---|
84f93cdaedc1ed5226b1ab475b4f4455 | 1 | [
[
612,
612
]
] | [
"eb6c77518189e632"
] | General | A-OKVQA | [
"General"
] | [
"Honey-Data-15M-Rollout1",
"Honey-Data-15M-Rollout2"
] | [
"A-OKVQA",
"aokvqa_cauldron_llava_format"
] | [
{
"id": "54c9600985359db7495ce9f7aa34d696",
"ori_id": "cauldron/aokvqa/images/aokvqa_00015360.png",
"subset": "A-OKVQA",
"messages": [
{
"from": "human",
"value": "<image>\nWhat color is the stripe running around the circumference of the plate?"
},
{
"from":... | |
c50ee7f267e495beefa520dd51049054 | 1 | [
[
640,
429
]
] | [
"e6a615f8c18f1c3a"
] | General | A-OKVQA | [
"General"
] | [
"Honey-Data-15M-Rollout1",
"Honey-Data-15M-Rollout2",
"Honey-Data-15M-Rollout3"
] | [
"A-OKVQA",
"aokvqa_cauldron_llava_format"
] | [
{
"id": "6d7b8ee2a0c8d0df191f38f706d44043",
"ori_id": "cauldron/aokvqa/images/aokvqa_00015364.png",
"subset": "A-OKVQA",
"messages": [
{
"from": "human",
"value": "<image>\nWhat is the man with the drink at risk of?"
},
{
"from": "gpt",
"value": "<th... | |
9778207e5f889d9713219a0daf01be3a | 1 | [
[
500,
375
]
] | [
"b585c5566ae2e1d1"
] | General | A-OKVQA | [
"General"
] | [
"Honey-Data-15M-Rollout1",
"Honey-Data-15M-Rollout2"
] | [
"A-OKVQA",
"aokvqa_cauldron_llava_format"
] | [
{
"id": "23892b212d38292ab600ca4dae12e8aa",
"ori_id": "cauldron/aokvqa/images/aokvqa_00015369.png",
"subset": "A-OKVQA",
"messages": [
{
"from": "human",
"value": "<image>\nWhat are the people playing?"
},
{
"from": "gpt",
"value": "<think>\n\n</thin... | |
9bc6f8da23f7cbd2657128ebf422b9a0 | 1 | [
[
640,
480
]
] | [
"c1dc46b88deba89a"
] | General | A-OKVQA | [
"General"
] | [
"Honey-Data-15M-Rollout1",
"Honey-Data-15M-Rollout2",
"Honey-Data-15M-Rollout3"
] | [
"A-OKVQA",
"aokvqa_cauldron_llava_format"
] | [
{
"id": "705f08cf7eec37227268e9a88001216a",
"ori_id": "cauldron/aokvqa/images/aokvqa_00015373.png",
"subset": "A-OKVQA",
"messages": [
{
"from": "human",
"value": "<image>\nWhat color is the main stripe on the right side of the queen sized bed?"
},
{
"from":... | |
f1ba04479de92d61070ac4dd15168023 | 1 | [
[
640,
480
]
] | [
"dcd393aca51a2c69"
] | General | A-OKVQA | [
"General"
] | [
"Honey-Data-15M-Rollout1",
"Honey-Data-15M-Rollout2"
] | [
"A-OKVQA",
"aokvqa_cauldron_llava_format"
] | [
{
"id": "538872e56bac4c8ab71ddbbc5812ebe0",
"ori_id": "cauldron/aokvqa/images/aokvqa_00015380.png",
"subset": "A-OKVQA",
"messages": [
{
"from": "human",
"value": "<image>\nHow many giraffes are walking together in front of the herd of buffalo?"
},
{
"from":... | |
d612a6d3b06d88f02d244af8fbb6bbcc | 1 | [
[
640,
406
]
] | [
"ea66c499a594b12f"
] | General | A-OKVQA | [
"General"
] | [
"Honey-Data-15M-Rollout1",
"Honey-Data-15M-Rollout2",
"Honey-Data-15M-Rollout3"
] | [
"A-OKVQA",
"aokvqa_cauldron_llava_format"
] | [
{
"id": "d9d6f99d8f3adb850d62d361c175b731",
"ori_id": "cauldron/aokvqa/images/aokvqa_00015388.png",
"subset": "A-OKVQA",
"messages": [
{
"from": "human",
"value": "<image>\nWhat color is the bow tie on the big teddy bear in the poster?"
},
{
"from": "gpt",
... | |
77d58801a98fc2eacddf9cabeecaebc6 | 1 | [
[
375,
500
]
] | [
"a9a1b54a7e124db5"
] | General | A-OKVQA | [
"General"
] | [
"Honey-Data-15M-Rollout1",
"Honey-Data-15M-Rollout2",
"Honey-Data-15M-Rollout3"
] | [
"A-OKVQA",
"aokvqa_cauldron_llava_format"
] | [
{
"id": "064e95a6be03b1507f39b5359c2687dd",
"ori_id": "cauldron/aokvqa/images/aokvqa_00015389.png",
"subset": "A-OKVQA",
"messages": [
{
"from": "human",
"value": "<image>\nWhat is the man adjusting?"
},
{
"from": "gpt",
"value": "<think>\n\n</think>... | |
6837b7b7b188db1ddfb8cb698e3dbecd | 1 | [
[
640,
427
]
] | [
"920a180a33b7fee7"
] | General | A-OKVQA | [
"General"
] | [
"Honey-Data-15M-Rollout1",
"Honey-Data-15M-Rollout2",
"Honey-Data-15M-Rollout3"
] | [
"A-OKVQA",
"aokvqa_cauldron_llava_format"
] | [
{
"id": "0e51bbe03ecf4c15c23292d3aac3e165",
"ori_id": "cauldron/aokvqa/images/aokvqa_00015393.png",
"subset": "A-OKVQA",
"messages": [
{
"from": "human",
"value": "<image>\nWhat is racing downward?"
},
{
"from": "gpt",
"value": "<think>\n\n</think>\n... | |
196cb9f277700cb0e2b3c9771aca87e1 | 1 | [
[
640,
427
]
] | [
"b13193124f4f1c6f"
] | General | A-OKVQA | [
"General"
] | [
"Honey-Data-15M-Rollout1",
"Honey-Data-15M-Rollout2",
"Honey-Data-15M-Rollout3"
] | [
"A-OKVQA",
"aokvqa_cauldron_llava_format"
] | [
{
"id": "4540524d0d45956240df3b302eee1d8f",
"ori_id": "cauldron/aokvqa/images/aokvqa_00015394.png",
"subset": "A-OKVQA",
"messages": [
{
"from": "human",
"value": "<image>\nWhat color is the sauce served in a circle around the vegetables?"
},
{
"from": "gpt"... | |
c4887b56d42a1d692855b7eebd86c974 | 1 | [
[
640,
499
]
] | [
"d01e3f6173656c13"
] | General | A-OKVQA | [
"General"
] | [
"Honey-Data-15M-Rollout1",
"Honey-Data-15M-Rollout2",
"Honey-Data-15M-Rollout3"
] | [
"A-OKVQA",
"aokvqa_cauldron_llava_format"
] | [
{
"id": "7c0a6daf981839d91a12e02001a91301",
"ori_id": "cauldron/aokvqa/images/aokvqa_00015395.png",
"subset": "A-OKVQA",
"messages": [
{
"from": "human",
"value": "<image>\nWho makes the item that is under the camera?"
},
{
"from": "gpt",
"value": "<... | |
73a50a7dec42e5f22dc376a34bc43af3 | 1 | [
[
640,
480
]
] | [
"c2ec923369c36dca"
] | General | A-OKVQA | [
"General"
] | [
"Honey-Data-15M-Rollout1",
"Honey-Data-15M-Rollout2",
"Honey-Data-15M-Rollout3"
] | [
"A-OKVQA",
"aokvqa_cauldron_llava_format"
] | [
{
"id": "8beaad3192f460241679005eda448cd7",
"ori_id": "cauldron/aokvqa/images/aokvqa_00015414.png",
"subset": "A-OKVQA",
"messages": [
{
"from": "human",
"value": "<image>\nWhat might the person be repairing?"
},
{
"from": "gpt",
"value": "<think>\n\... | |
902e5e16cbde0673bb51fdd647437732 | 1 | [
[
640,
467
]
] | [
"9a9db99d21929678"
] | General | A-OKVQA | [
"General"
] | [
"Honey-Data-15M-Rollout1",
"Honey-Data-15M-Rollout2"
] | [
"A-OKVQA",
"aokvqa_cauldron_llava_format"
] | [
{
"id": "b6529489879b1029db4c6c7beb6cf837",
"ori_id": "cauldron/aokvqa/images/aokvqa_00015424.png",
"subset": "A-OKVQA",
"messages": [
{
"from": "human",
"value": "<image>\nWhat color is the lettering on the center of the blue bus windowfront?"
},
{
"from": ... | |
8741bcb87c7367c3c770ee3ae3100cc0 | 1 | [
[
437,
640
]
] | [
"e3f3990c9cb4266c"
] | General | A-OKVQA | [
"General"
] | [
"Honey-Data-15M-Rollout1",
"Honey-Data-15M-Rollout2"
] | [
"A-OKVQA",
"aokvqa_cauldron_llava_format"
] | [
{
"id": "ea22f82602ff878f06c153f03d58e388",
"ori_id": "cauldron/aokvqa/images/aokvqa_00015435.png",
"subset": "A-OKVQA",
"messages": [
{
"from": "human",
"value": "<image>\nWhat is on the boy's hand?"
},
{
"from": "gpt",
"value": "<think>\n\n</think>... | |
b0876192df4f1ad508ff125182a9b636 | 1 | [
[
512,
640
]
] | [
"dcb863c27a72e468"
] | General | A-OKVQA | [
"General"
] | [
"Honey-Data-15M-Rollout1",
"Honey-Data-15M-Rollout2",
"Honey-Data-15M-Rollout3"
] | [
"A-OKVQA",
"aokvqa_cauldron_llava_format"
] | [
{
"id": "c0e49c2817e200674e9f452c97f4ea0a",
"ori_id": "cauldron/aokvqa/images/aokvqa_00015442.png",
"subset": "A-OKVQA",
"messages": [
{
"from": "human",
"value": "<image>\nWhat is coming out of the toilet bowl?"
},
{
"from": "gpt",
"value": "<think>... | |
f277a23d69bd08313a007e4be42b2030 | 1 | [
[
480,
640
]
] | [
"d13e31954a99b6e1"
] | General | A-OKVQA | [
"General"
] | [
"Honey-Data-15M-Rollout1",
"Honey-Data-15M-Rollout2"
] | [
"A-OKVQA",
"aokvqa_cauldron_llava_format"
] | [
{
"id": "83d38804b6bcb56787ebe44dc28a41cb",
"ori_id": "cauldron/aokvqa/images/aokvqa_00015446.png",
"subset": "A-OKVQA",
"messages": [
{
"from": "human",
"value": "<image>\nWhat do you have to do in order to get the urinals to flush?"
},
{
"from": "gpt",
... | |
76c43e22b0110404c99000351798ec58 | 1 | [
[
640,
383
]
] | [
"c6356ade253099f1"
] | General | A-OKVQA | [
"General"
] | [
"Honey-Data-15M-Rollout1",
"Honey-Data-15M-Rollout2",
"Honey-Data-15M-Rollout3"
] | [
"A-OKVQA",
"aokvqa_cauldron_llava_format"
] | [
{
"id": "8c4e987036f9e191259f93d61b53b30f",
"ori_id": "cauldron/aokvqa/images/aokvqa_00015448.png",
"subset": "A-OKVQA",
"messages": [
{
"from": "human",
"value": "<image>\nWhat is the green stuff on top of?"
},
{
"from": "gpt",
"value": "<think>\n\n... | |
d10039185e7360b5775160d87c712c57 | 1 | [
[
427,
640
]
] | [
"956a5ab50b55729c"
] | General | A-OKVQA | [
"General"
] | [
"Honey-Data-15M-Rollout1",
"Honey-Data-15M-Rollout2",
"Honey-Data-15M-Rollout3"
] | [
"A-OKVQA",
"aokvqa_cauldron_llava_format"
] | [
{
"id": "e1b76376ba482fcbd9da509f4a916669",
"ori_id": "cauldron/aokvqa/images/aokvqa_00015449.png",
"subset": "A-OKVQA",
"messages": [
{
"from": "human",
"value": "<image>\nWhat is the purpose of the item tied around his neck?"
},
{
"from": "gpt",
"v... | |
bf3271239f767cae43719bd5ff0c40a6 | 1 | [
[
640,
427
]
] | [
"dc930ae627433de4"
] | General | A-OKVQA | [
"General"
] | [
"Honey-Data-15M-Rollout1",
"Honey-Data-15M-Rollout2",
"Honey-Data-15M-Rollout3"
] | [
"A-OKVQA",
"aokvqa_cauldron_llava_format"
] | [
{
"id": "d6d6df2ac39b6e2672cfe9d990ac04a7",
"ori_id": "cauldron/aokvqa/images/aokvqa_00015459.png",
"subset": "A-OKVQA",
"messages": [
{
"from": "human",
"value": "<image>\nWhat event might this be for?"
},
{
"from": "gpt",
"value": "<think>\n\n</thi... | |
99f7db6e06813f09c307a89d139bf640 | 1 | [
[
427,
640
]
] | [
"890b76360cd9b3b3"
] | General | A-OKVQA | [
"General"
] | [
"Honey-Data-15M-Rollout1",
"Honey-Data-15M-Rollout2",
"Honey-Data-15M-Rollout3"
] | [
"A-OKVQA",
"aokvqa_cauldron_llava_format"
] | [
{
"id": "3b343510dea7456173ed0a091bdce870",
"ori_id": "cauldron/aokvqa/images/aokvqa_00015460.png",
"subset": "A-OKVQA",
"messages": [
{
"from": "human",
"value": "<image>\nWhat is the man swinging?"
},
{
"from": "gpt",
"value": "<think>\n\n</think>\... | |
f1e25a9ae4fab4444cc9918d19774dd8 | 1 | [
[
480,
640
]
] | [
"e1d87e263f3d1288"
] | General | A-OKVQA | [
"General"
] | [
"Honey-Data-15M-Rollout1",
"Honey-Data-15M-Rollout2"
] | [
"A-OKVQA",
"aokvqa_cauldron_llava_format"
] | [
{
"id": "ced42eef0f0b8d2fd5d06adb74bce8de",
"ori_id": "cauldron/aokvqa/images/aokvqa_00015475.png",
"subset": "A-OKVQA",
"messages": [
{
"from": "human",
"value": "<image>\nWhat color are the stripes on the side of the bathroom wall?"
},
{
"from": "gpt",
... | |
2701c0550613ac0d06d270c8fe219241 | 1 | [
[
640,
339
]
] | [
"878d7c199b448e9b"
] | General | A-OKVQA | [
"General"
] | [
"Honey-Data-15M-Rollout1",
"Honey-Data-15M-Rollout2",
"Honey-Data-15M-Rollout3"
] | [
"A-OKVQA",
"aokvqa_cauldron_llava_format"
] | [
{
"id": "a1d719676525723607974c0176f1971f",
"ori_id": "cauldron/aokvqa/images/aokvqa_00015476.png",
"subset": "A-OKVQA",
"messages": [
{
"from": "human",
"value": "<image>\nWhat is the white appliance used for?"
},
{
"from": "gpt",
"value": "<think>\... | |
45fffba2488354e9318a655c02f9a6af | 1 | [
[
361,
640
]
] | [
"db0a52370bccfd84"
] | General | A-OKVQA | [
"General"
] | [
"Honey-Data-15M-Rollout1",
"Honey-Data-15M-Rollout2"
] | [
"A-OKVQA",
"aokvqa_cauldron_llava_format"
] | [
{
"id": "2a4ae814d816641d741bdd0034c3adff",
"ori_id": "cauldron/aokvqa/images/aokvqa_00015486.png",
"subset": "A-OKVQA",
"messages": [
{
"from": "human",
"value": "<image>\nIn what country would you find this type of cuisine?"
},
{
"from": "gpt",
"va... | |
829bd6dea82941415dff21d4831bb9be | 1 | [
[
640,
427
]
] | [
"fa43e0f8b3506bb0"
] | General | A-OKVQA | [
"General"
] | [
"Honey-Data-15M-Rollout1",
"Honey-Data-15M-Rollout2",
"Honey-Data-15M-Rollout3"
] | [
"A-OKVQA",
"aokvqa_cauldron_llava_format"
] | [
{
"id": "30f7b0726cbda7eb9fa594045b682052",
"ori_id": "cauldron/aokvqa/images/aokvqa_00015494.png",
"subset": "A-OKVQA",
"messages": [
{
"from": "human",
"value": "<image>\nWhat term is appropriate to describe this animal?"
},
{
"from": "gpt",
"value... | |
2390078eb2ee196510830f0a951a4fcc | 1 | [
[
480,
640
]
] | [
"dc66bee29178e411"
] | General | A-OKVQA | [
"General"
] | [
"Honey-Data-15M-Rollout1",
"Honey-Data-15M-Rollout2",
"Honey-Data-15M-Rollout3"
] | [
"A-OKVQA",
"aokvqa_cauldron_llava_format"
] | [
{
"id": "c1a04e61f4f9dced5e5749cabb303496",
"ori_id": "cauldron/aokvqa/images/aokvqa_00015495.png",
"subset": "A-OKVQA",
"messages": [
{
"from": "human",
"value": "<image>\nWhat is the brown and white animal doing with its neck in the air?"
},
{
"from": "gpt... | |
f1cf5a1976486274827ff93f33392ab0 | 1 | [
[
427,
640
]
] | [
"bc3073644e8d339d"
] | General | A-OKVQA | [
"General"
] | [
"Honey-Data-15M-Rollout1",
"Honey-Data-15M-Rollout2",
"Honey-Data-15M-Rollout3"
] | [
"A-OKVQA",
"aokvqa_cauldron_llava_format"
] | [
{
"id": "6603037b9c4ea7a60ebc106050b0d36a",
"ori_id": "cauldron/aokvqa/images/aokvqa_00015497.png",
"subset": "A-OKVQA",
"messages": [
{
"from": "human",
"value": "<image>\nWhat does the very large toy resemble?"
},
{
"from": "gpt",
"value": "<think>... | |
f41fc461d7d14be22df7f1c7761378da | 1 | [
[
500,
375
]
] | [
"f6f0c10a7f3c20ab"
] | General | A-OKVQA | [
"General"
] | [
"Honey-Data-15M-Rollout1",
"Honey-Data-15M-Rollout2",
"Honey-Data-15M-Rollout3"
] | [
"A-OKVQA",
"aokvqa_cauldron_llava_format"
] | [
{
"id": "60c21d869a1df167227d872a5952197c",
"ori_id": "cauldron/aokvqa/images/aokvqa_00015501.png",
"subset": "A-OKVQA",
"messages": [
{
"from": "human",
"value": "<image>\nWhat is the purpose of the black and silver square appliance?"
},
{
"from": "gpt",
... | |
9dba7b6e9db7e0d0afa7b45c394ca8c6 | 1 | [
[
640,
360
]
] | [
"c6c6da9b191dc495"
] | General | A-OKVQA | [
"General"
] | [
"Honey-Data-15M-Rollout1",
"Honey-Data-15M-Rollout2",
"Honey-Data-15M-Rollout3"
] | [
"A-OKVQA",
"aokvqa_cauldron_llava_format"
] | [
{
"id": "c68162264721fac74e63d7fda7e101b3",
"ori_id": "cauldron/aokvqa/images/aokvqa_00015505.png",
"subset": "A-OKVQA",
"messages": [
{
"from": "human",
"value": "<image>\nWhat are the animals near?"
},
{
"from": "gpt",
"value": "<think>\n\n</think>... | |
6a046a0723483e3144e58b1f9fb2eb67 | 1 | [
[
500,
375
]
] | [
"931f72e42b703c87"
] | General | A-OKVQA | [
"General"
] | [
"Honey-Data-15M-Rollout1",
"Honey-Data-15M-Rollout2"
] | [
"A-OKVQA",
"aokvqa_cauldron_llava_format"
] | [
{
"id": "6bd9c3f6625650ba5ebea82e1f211cc2",
"ori_id": "cauldron/aokvqa/images/aokvqa_00015511.png",
"subset": "A-OKVQA",
"messages": [
{
"from": "human",
"value": "<image>\nWhat color is the netting on this purse?"
},
{
"from": "gpt",
"value": "<thin... | |
110fde0803761b89961d9b970012e694 | 1 | [
[
612,
612
]
] | [
"c06651e97bd16197"
] | General | A-OKVQA | [
"General"
] | [
"Honey-Data-15M-Rollout1",
"Honey-Data-15M-Rollout2",
"Honey-Data-15M-Rollout3"
] | [
"A-OKVQA",
"aokvqa_cauldron_llava_format"
] | [
{
"id": "42ebe87808ff69c8a1bcd6aad962888d",
"ori_id": "cauldron/aokvqa/images/aokvqa_00015512.png",
"subset": "A-OKVQA",
"messages": [
{
"from": "human",
"value": "<image>\nWhat is in the white cup?"
},
{
"from": "gpt",
"value": "<think>\n\n</think>\... | |
7ffb649cf7254419449aedf73cb5d77f | 1 | [
[
640,
540
]
] | [
"e9cb961469e99c34"
] | General | A-OKVQA | [
"General"
] | [
"Honey-Data-15M-Rollout1",
"Honey-Data-15M-Rollout2",
"Honey-Data-15M-Rollout3"
] | [
"A-OKVQA",
"aokvqa_cauldron_llava_format"
] | [
{
"id": "70906d9f0bbaf2ef5db63b1b86116aa6",
"ori_id": "cauldron/aokvqa/images/aokvqa_00015514.png",
"subset": "A-OKVQA",
"messages": [
{
"from": "human",
"value": "<image>\nWhat is near the water?"
},
{
"from": "gpt",
"value": "<think>\n\n</think>\n\... | |
2b96059a5d8ec041871c258d184be06a | 1 | [
[
640,
480
]
] | [
"819a77e2159cf06b"
] | General | A-OKVQA | [
"General"
] | [
"Honey-Data-15M-Rollout1",
"Honey-Data-15M-Rollout2"
] | [
"A-OKVQA",
"aokvqa_cauldron_llava_format"
] | [
{
"id": "6e01c9447ee8a7b16e2c4e81b9118e83",
"ori_id": "cauldron/aokvqa/images/aokvqa_00015516.png",
"subset": "A-OKVQA",
"messages": [
{
"from": "human",
"value": "<image>\nWhat is the name of the operating system for both of these computers?"
},
{
"from": "... | |
21a80393c77b51a1349ea903a22afc45 | 1 | [
[
640,
429
]
] | [
"c34be18d6e9768c1"
] | General | A-OKVQA | [
"General"
] | [
"Honey-Data-15M-Rollout1",
"Honey-Data-15M-Rollout2",
"Honey-Data-15M-Rollout3"
] | [
"A-OKVQA",
"aokvqa_cauldron_llava_format"
] | [
{
"id": "f0597d3a9489df439babe12d26dd04db",
"ori_id": "cauldron/aokvqa/images/aokvqa_00015518.png",
"subset": "A-OKVQA",
"messages": [
{
"from": "human",
"value": "<image>\nWhich animals are near the trees?"
},
{
"from": "gpt",
"value": "<think>\n\n<... | |
e4fed498cce3577e823bbdb216fdc0c6 | 1 | [
[
640,
429
]
] | [
"b8629d8756b54aac"
] | General | A-OKVQA | [
"General"
] | [
"Honey-Data-15M-Rollout1",
"Honey-Data-15M-Rollout2",
"Honey-Data-15M-Rollout3"
] | [
"A-OKVQA",
"aokvqa_cauldron_llava_format"
] | [
{
"id": "a90b3c1794cc356b8abde7880893c595",
"ori_id": "cauldron/aokvqa/images/aokvqa_00015524.png",
"subset": "A-OKVQA",
"messages": [
{
"from": "human",
"value": "<image>\nHow many bottles of wine are to the right in front to the man who is cutting the pizza?"
},
{... | |
8246be8b630417c44918fcba766ecdf4 | 1 | [
[
640,
480
]
] | [
"e5c8d2646413dafc"
] | General | A-OKVQA | [
"General"
] | [
"Honey-Data-15M-Rollout1",
"Honey-Data-15M-Rollout2",
"Honey-Data-15M-Rollout3"
] | [
"A-OKVQA",
"aokvqa_cauldron_llava_format"
] | [
{
"id": "62399362b755fcc981502a2bdd4b285a",
"ori_id": "cauldron/aokvqa/images/aokvqa_00015534.png",
"subset": "A-OKVQA",
"messages": [
{
"from": "human",
"value": "<image>\nHow many people are in wetsuits standing before the crashing wave?"
},
{
"from": "gpt... | |
6a31cf06b30f1694954fe7cc2b03218e | 1 | [
[
396,
640
]
] | [
"c9d59fef6420292c"
] | General | A-OKVQA | [
"General"
] | [
"Honey-Data-15M-Rollout1",
"Honey-Data-15M-Rollout2",
"Honey-Data-15M-Rollout3"
] | [
"A-OKVQA",
"aokvqa_cauldron_llava_format"
] | [
{
"id": "830f0fa7455d0f90c7d3fe766a16cf2d",
"ori_id": "cauldron/aokvqa/images/aokvqa_00015543.png",
"subset": "A-OKVQA",
"messages": [
{
"from": "human",
"value": "<image>\nWhat has the big ears?"
},
{
"from": "gpt",
"value": "<think>\n\n</think>\n\n... | |
692ff9728c4e1630c368cb31b81a7b74 | 1 | [
[
640,
480
]
] | [
"f6c33213d05d9dd0"
] | General | A-OKVQA | [
"General"
] | [
"Honey-Data-15M-Rollout1",
"Honey-Data-15M-Rollout2",
"Honey-Data-15M-Rollout3"
] | [
"A-OKVQA",
"aokvqa_cauldron_llava_format"
] | [
{
"id": "12b3d4ba5d1c7bda694e6d4228ae584b",
"ori_id": "cauldron/aokvqa/images/aokvqa_00015544.png",
"subset": "A-OKVQA",
"messages": [
{
"from": "human",
"value": "<image>\nWhat is the man looking at?"
},
{
"from": "gpt",
"value": "<think>\n\n</think... | |
cf49f4f710c7cefea44635566d1893b8 | 1 | [
[
426,
640
]
] | [
"c0c0cc7fbcec1366"
] | General | A-OKVQA | [
"General"
] | [
"Honey-Data-15M-Rollout1",
"Honey-Data-15M-Rollout2"
] | [
"A-OKVQA",
"aokvqa_cauldron_llava_format"
] | [
{
"id": "d4f42d6997d9a198fdd7d32ba455d2cc",
"ori_id": "cauldron/aokvqa/images/aokvqa_00015551.png",
"subset": "A-OKVQA",
"messages": [
{
"from": "human",
"value": "<image>\nWhat is next to the lamppost?"
},
{
"from": "gpt",
"value": "<think>\n\n</thi... | |
5c01737538f4a4d633dffaf203da00fa | 1 | [
[
639,
640
]
] | [
"f33e0e8c91d87871"
] | General | A-OKVQA | [
"General"
] | [
"Honey-Data-15M-Rollout1",
"Honey-Data-15M-Rollout2"
] | [
"A-OKVQA",
"aokvqa_cauldron_llava_format"
] | [
{
"id": "02eda7673e0f51f4c05c3f8d6a3e9678",
"ori_id": "cauldron/aokvqa/images/aokvqa_00015557.png",
"subset": "A-OKVQA",
"messages": [
{
"from": "human",
"value": "<image>\nWhat type of bird is on the street?"
},
{
"from": "gpt",
"value": "<think>\n\... |
Honey-Data-V2
A multimodal supervised fine-tuning corpus of 19,707,852 image groups carrying 44,295,078 conversations, spread over 8 task categories and 420 subsets (5.81 TB).
Honey-Data-V2 extends Honey-Data-15M, the corpus behind Bee-8B. The original pool was re-curated under stricter structural rules, re-annotated by an upgraded stack of frontier models that contributes up to three independent answers per instruction, and extended with newly released community corpora.
One record is one image group
Unlike the usual one-row-per-conversation layout, a record here collects every conversation that refers to the same image. The image bytes are therefore stored once, no matter how many dialogues discuss it. Across the corpus this is the difference between 19,708,047 stored images and the 44,295,078 conversations that use them.
from datasets import load_dataset, get_dataset_config_names
subsets = get_dataset_config_names("HoneyDataV2/Honey-Data-V2")
ds = load_dataset("HoneyDataV2/Honey-Data-V2", subsets[0], split="train")
rec = ds[0]
rec["images"][0] # a PIL image
len(rec["data"]) # how many dialogues share it
rec["data"][0]["messages"] # [{'from': 'human', 'value': ...}, {'from': 'gpt', 'value': ...}]
rec["data"][0]["provenance"] # which model wrote and which verified this answer
Image encoding
Images are stored as lossless WebP. Where the source was already JPEG, or
where WebP came out larger than the original, the original bytes are kept
untouched. WebP holds the same pixels as the PNGs it replaces in roughly 60% of
the bytes. Decoding is transparent: datasets returns PIL images either way.
For RGBA images the alpha channel is preserved exactly and RGB is preserved wherever alpha > 0. PNG stores arbitrary colour under fully transparent pixels and WebP does not carry it over; no reader can observe those values.
Record fields
| column | type | meaning |
|---|---|---|
id |
string | identifier of the image group |
images |
list of image | the images, decoded to PIL by datasets |
n_images |
int32 | how many images the group holds |
image_sizes |
list of [width, height] | pixel dimensions, one pair per image |
image_phashes |
list of string | perceptual hash, one per image |
category |
string | task category; matches the directory |
source_subset |
string | subset; matches the directory |
categories |
list of string | every category label the upstream corpora gave this group |
sources |
list of string | every upstream corpus that contributed a dialogue |
source_subsets |
list of string | every upstream subset name |
data |
list of struct | the dialogues, below |
Each element of data:
| field | meaning |
|---|---|
id, ori_id |
identifiers of this dialogue and of the record it came from |
messages |
the dialogue as from / value pairs, human and gpt |
n_turns |
number of turns |
cot_level |
short or long chain-of-thought |
original_answers |
the answers before rewriting |
provenance |
which model performed each step |
source, subset, source_subset, category |
where this dialogue came from |
provenance names the model used at each stage, so a subset of the corpus can be selected by
annotator: question_image_consist (the image-question consistency check), answer_rewrite,
reasoning_rewrite, and answer_consist (verification of the rewritten answer). A value of null
means that stage did not apply — determinate tasks such as OCR transcription and box-level grounding
are filtered but never rewritten.
Composition
| category | subsets | image groups | conversations | size |
|---|---|---|---|---|
| Caption | 13 | 1,413,122 | 2,011,253 | 1.21 TB |
| Chart | 77 | 4,665,363 | 11,036,064 | 0.87 TB |
| Document | 49 | 2,271,245 | 4,766,060 | 0.67 TB |
| GUI-Grounding | 4 | 500,916 | 2,803,848 | 0.12 TB |
| General | 122 | 4,298,102 | 12,952,088 | 1.75 TB |
| Grounding | 27 | 1,979,196 | 3,435,355 | 0.75 TB |
| OCR | 45 | 2,564,793 | 3,625,483 | 0.37 TB |
| STEM | 83 | 2,015,115 | 3,664,927 | 0.07 TB |
| total | 420 | 19,707,852 | 44,295,078 | 5.81 TB |
A subset name that appears in more than one category is qualified with its category, for example
Chart-CoSyn and Document-CoSyn.
Provenance of the answers
| stage | models |
|---|---|
| answer rewriting | Qwen3-VL-235B-A22B-Instruct, Kimi-K2.5, MAI-UI-8B |
| reasoning rewriting | Qwen3-VL-235B-A22B-Thinking, Kimi-K2.5, Doubao-Thinking |
| image-question consistency | Qwen3-VL-30B-A3B-Instruct |
| answer verification | Qwen3-235B-A22B-Instruct |
sources records which annotation pass a dialogue belongs to: Honey-Data-15M-Rollout1 is the
re-curated original pool, Rollout2 and Rollout3 are the two further independent passes over the
same instructions. Dialogues taken from newly incorporated community corpora carry that corpus's
name instead.
Licensing information
Honey-Data-V2 aggregates many publicly available datasets, each governed by its own licence. Anyone using this corpus must observe the licence attached to each constituent dataset. To the extent we hold any rights in the curation and the generated answers, those are released under CC-BY-4.0.
Citation
@inproceedings{zhang2026bee,
title = {Bee: A High-Quality Corpus and Full-Stack Suite to Unlock Advanced Fully Open MLLMs},
author = {Yi Zhang and Bolin Ni and Xin-Sheng Chen and Hengrui Zhang and Yongming Rao and
Houwen Peng and Qinglin Lu and Han Hu and Meng-Hao Guo and Shi-min Hu},
booktitle = {The Fourteenth International Conference on Learning Representations},
year = {2026},
}
- Downloads last month
- 48,720