Dataset Viewer
Auto-converted to Parquet Duplicate
id
string
images
images list
n_images
int32
image_sizes
list
image_phashes
list
category
string
source_subset
string
categories
list
sources
list
source_subsets
list
data
list
84f93cdaedc1ed5226b1ab475b4f4455
1
[ [ 612, 612 ] ]
[ "eb6c77518189e632" ]
General
A-OKVQA
[ "General" ]
[ "Honey-Data-15M-Rollout1", "Honey-Data-15M-Rollout2" ]
[ "A-OKVQA", "aokvqa_cauldron_llava_format" ]
[ { "id": "54c9600985359db7495ce9f7aa34d696", "ori_id": "cauldron/aokvqa/images/aokvqa_00015360.png", "subset": "A-OKVQA", "messages": [ { "from": "human", "value": "<image>\nWhat color is the stripe running around the circumference of the plate?" }, { "from":...
c50ee7f267e495beefa520dd51049054
1
[ [ 640, 429 ] ]
[ "e6a615f8c18f1c3a" ]
General
A-OKVQA
[ "General" ]
[ "Honey-Data-15M-Rollout1", "Honey-Data-15M-Rollout2", "Honey-Data-15M-Rollout3" ]
[ "A-OKVQA", "aokvqa_cauldron_llava_format" ]
[ { "id": "6d7b8ee2a0c8d0df191f38f706d44043", "ori_id": "cauldron/aokvqa/images/aokvqa_00015364.png", "subset": "A-OKVQA", "messages": [ { "from": "human", "value": "<image>\nWhat is the man with the drink at risk of?" }, { "from": "gpt", "value": "<th...
9778207e5f889d9713219a0daf01be3a
1
[ [ 500, 375 ] ]
[ "b585c5566ae2e1d1" ]
General
A-OKVQA
[ "General" ]
[ "Honey-Data-15M-Rollout1", "Honey-Data-15M-Rollout2" ]
[ "A-OKVQA", "aokvqa_cauldron_llava_format" ]
[ { "id": "23892b212d38292ab600ca4dae12e8aa", "ori_id": "cauldron/aokvqa/images/aokvqa_00015369.png", "subset": "A-OKVQA", "messages": [ { "from": "human", "value": "<image>\nWhat are the people playing?" }, { "from": "gpt", "value": "<think>\n\n</thin...
9bc6f8da23f7cbd2657128ebf422b9a0
1
[ [ 640, 480 ] ]
[ "c1dc46b88deba89a" ]
General
A-OKVQA
[ "General" ]
[ "Honey-Data-15M-Rollout1", "Honey-Data-15M-Rollout2", "Honey-Data-15M-Rollout3" ]
[ "A-OKVQA", "aokvqa_cauldron_llava_format" ]
[ { "id": "705f08cf7eec37227268e9a88001216a", "ori_id": "cauldron/aokvqa/images/aokvqa_00015373.png", "subset": "A-OKVQA", "messages": [ { "from": "human", "value": "<image>\nWhat color is the main stripe on the right side of the queen sized bed?" }, { "from":...
f1ba04479de92d61070ac4dd15168023
1
[ [ 640, 480 ] ]
[ "dcd393aca51a2c69" ]
General
A-OKVQA
[ "General" ]
[ "Honey-Data-15M-Rollout1", "Honey-Data-15M-Rollout2" ]
[ "A-OKVQA", "aokvqa_cauldron_llava_format" ]
[ { "id": "538872e56bac4c8ab71ddbbc5812ebe0", "ori_id": "cauldron/aokvqa/images/aokvqa_00015380.png", "subset": "A-OKVQA", "messages": [ { "from": "human", "value": "<image>\nHow many giraffes are walking together in front of the herd of buffalo?" }, { "from":...
d612a6d3b06d88f02d244af8fbb6bbcc
1
[ [ 640, 406 ] ]
[ "ea66c499a594b12f" ]
General
A-OKVQA
[ "General" ]
[ "Honey-Data-15M-Rollout1", "Honey-Data-15M-Rollout2", "Honey-Data-15M-Rollout3" ]
[ "A-OKVQA", "aokvqa_cauldron_llava_format" ]
[ { "id": "d9d6f99d8f3adb850d62d361c175b731", "ori_id": "cauldron/aokvqa/images/aokvqa_00015388.png", "subset": "A-OKVQA", "messages": [ { "from": "human", "value": "<image>\nWhat color is the bow tie on the big teddy bear in the poster?" }, { "from": "gpt", ...
77d58801a98fc2eacddf9cabeecaebc6
1
[ [ 375, 500 ] ]
[ "a9a1b54a7e124db5" ]
General
A-OKVQA
[ "General" ]
[ "Honey-Data-15M-Rollout1", "Honey-Data-15M-Rollout2", "Honey-Data-15M-Rollout3" ]
[ "A-OKVQA", "aokvqa_cauldron_llava_format" ]
[ { "id": "064e95a6be03b1507f39b5359c2687dd", "ori_id": "cauldron/aokvqa/images/aokvqa_00015389.png", "subset": "A-OKVQA", "messages": [ { "from": "human", "value": "<image>\nWhat is the man adjusting?" }, { "from": "gpt", "value": "<think>\n\n</think>...
6837b7b7b188db1ddfb8cb698e3dbecd
1
[ [ 640, 427 ] ]
[ "920a180a33b7fee7" ]
General
A-OKVQA
[ "General" ]
[ "Honey-Data-15M-Rollout1", "Honey-Data-15M-Rollout2", "Honey-Data-15M-Rollout3" ]
[ "A-OKVQA", "aokvqa_cauldron_llava_format" ]
[ { "id": "0e51bbe03ecf4c15c23292d3aac3e165", "ori_id": "cauldron/aokvqa/images/aokvqa_00015393.png", "subset": "A-OKVQA", "messages": [ { "from": "human", "value": "<image>\nWhat is racing downward?" }, { "from": "gpt", "value": "<think>\n\n</think>\n...
196cb9f277700cb0e2b3c9771aca87e1
1
[ [ 640, 427 ] ]
[ "b13193124f4f1c6f" ]
General
A-OKVQA
[ "General" ]
[ "Honey-Data-15M-Rollout1", "Honey-Data-15M-Rollout2", "Honey-Data-15M-Rollout3" ]
[ "A-OKVQA", "aokvqa_cauldron_llava_format" ]
[ { "id": "4540524d0d45956240df3b302eee1d8f", "ori_id": "cauldron/aokvqa/images/aokvqa_00015394.png", "subset": "A-OKVQA", "messages": [ { "from": "human", "value": "<image>\nWhat color is the sauce served in a circle around the vegetables?" }, { "from": "gpt"...
c4887b56d42a1d692855b7eebd86c974
1
[ [ 640, 499 ] ]
[ "d01e3f6173656c13" ]
General
A-OKVQA
[ "General" ]
[ "Honey-Data-15M-Rollout1", "Honey-Data-15M-Rollout2", "Honey-Data-15M-Rollout3" ]
[ "A-OKVQA", "aokvqa_cauldron_llava_format" ]
[ { "id": "7c0a6daf981839d91a12e02001a91301", "ori_id": "cauldron/aokvqa/images/aokvqa_00015395.png", "subset": "A-OKVQA", "messages": [ { "from": "human", "value": "<image>\nWho makes the item that is under the camera?" }, { "from": "gpt", "value": "<...
73a50a7dec42e5f22dc376a34bc43af3
1
[ [ 640, 480 ] ]
[ "c2ec923369c36dca" ]
General
A-OKVQA
[ "General" ]
[ "Honey-Data-15M-Rollout1", "Honey-Data-15M-Rollout2", "Honey-Data-15M-Rollout3" ]
[ "A-OKVQA", "aokvqa_cauldron_llava_format" ]
[ { "id": "8beaad3192f460241679005eda448cd7", "ori_id": "cauldron/aokvqa/images/aokvqa_00015414.png", "subset": "A-OKVQA", "messages": [ { "from": "human", "value": "<image>\nWhat might the person be repairing?" }, { "from": "gpt", "value": "<think>\n\...
902e5e16cbde0673bb51fdd647437732
1
[ [ 640, 467 ] ]
[ "9a9db99d21929678" ]
General
A-OKVQA
[ "General" ]
[ "Honey-Data-15M-Rollout1", "Honey-Data-15M-Rollout2" ]
[ "A-OKVQA", "aokvqa_cauldron_llava_format" ]
[ { "id": "b6529489879b1029db4c6c7beb6cf837", "ori_id": "cauldron/aokvqa/images/aokvqa_00015424.png", "subset": "A-OKVQA", "messages": [ { "from": "human", "value": "<image>\nWhat color is the lettering on the center of the blue bus windowfront?" }, { "from": ...
8741bcb87c7367c3c770ee3ae3100cc0
1
[ [ 437, 640 ] ]
[ "e3f3990c9cb4266c" ]
General
A-OKVQA
[ "General" ]
[ "Honey-Data-15M-Rollout1", "Honey-Data-15M-Rollout2" ]
[ "A-OKVQA", "aokvqa_cauldron_llava_format" ]
[ { "id": "ea22f82602ff878f06c153f03d58e388", "ori_id": "cauldron/aokvqa/images/aokvqa_00015435.png", "subset": "A-OKVQA", "messages": [ { "from": "human", "value": "<image>\nWhat is on the boy's hand?" }, { "from": "gpt", "value": "<think>\n\n</think>...
b0876192df4f1ad508ff125182a9b636
1
[ [ 512, 640 ] ]
[ "dcb863c27a72e468" ]
General
A-OKVQA
[ "General" ]
[ "Honey-Data-15M-Rollout1", "Honey-Data-15M-Rollout2", "Honey-Data-15M-Rollout3" ]
[ "A-OKVQA", "aokvqa_cauldron_llava_format" ]
[ { "id": "c0e49c2817e200674e9f452c97f4ea0a", "ori_id": "cauldron/aokvqa/images/aokvqa_00015442.png", "subset": "A-OKVQA", "messages": [ { "from": "human", "value": "<image>\nWhat is coming out of the toilet bowl?" }, { "from": "gpt", "value": "<think>...
f277a23d69bd08313a007e4be42b2030
1
[ [ 480, 640 ] ]
[ "d13e31954a99b6e1" ]
General
A-OKVQA
[ "General" ]
[ "Honey-Data-15M-Rollout1", "Honey-Data-15M-Rollout2" ]
[ "A-OKVQA", "aokvqa_cauldron_llava_format" ]
[ { "id": "83d38804b6bcb56787ebe44dc28a41cb", "ori_id": "cauldron/aokvqa/images/aokvqa_00015446.png", "subset": "A-OKVQA", "messages": [ { "from": "human", "value": "<image>\nWhat do you have to do in order to get the urinals to flush?" }, { "from": "gpt", ...
76c43e22b0110404c99000351798ec58
1
[ [ 640, 383 ] ]
[ "c6356ade253099f1" ]
General
A-OKVQA
[ "General" ]
[ "Honey-Data-15M-Rollout1", "Honey-Data-15M-Rollout2", "Honey-Data-15M-Rollout3" ]
[ "A-OKVQA", "aokvqa_cauldron_llava_format" ]
[ { "id": "8c4e987036f9e191259f93d61b53b30f", "ori_id": "cauldron/aokvqa/images/aokvqa_00015448.png", "subset": "A-OKVQA", "messages": [ { "from": "human", "value": "<image>\nWhat is the green stuff on top of?" }, { "from": "gpt", "value": "<think>\n\n...
d10039185e7360b5775160d87c712c57
1
[ [ 427, 640 ] ]
[ "956a5ab50b55729c" ]
General
A-OKVQA
[ "General" ]
[ "Honey-Data-15M-Rollout1", "Honey-Data-15M-Rollout2", "Honey-Data-15M-Rollout3" ]
[ "A-OKVQA", "aokvqa_cauldron_llava_format" ]
[ { "id": "e1b76376ba482fcbd9da509f4a916669", "ori_id": "cauldron/aokvqa/images/aokvqa_00015449.png", "subset": "A-OKVQA", "messages": [ { "from": "human", "value": "<image>\nWhat is the purpose of the item tied around his neck?" }, { "from": "gpt", "v...
bf3271239f767cae43719bd5ff0c40a6
1
[ [ 640, 427 ] ]
[ "dc930ae627433de4" ]
General
A-OKVQA
[ "General" ]
[ "Honey-Data-15M-Rollout1", "Honey-Data-15M-Rollout2", "Honey-Data-15M-Rollout3" ]
[ "A-OKVQA", "aokvqa_cauldron_llava_format" ]
[ { "id": "d6d6df2ac39b6e2672cfe9d990ac04a7", "ori_id": "cauldron/aokvqa/images/aokvqa_00015459.png", "subset": "A-OKVQA", "messages": [ { "from": "human", "value": "<image>\nWhat event might this be for?" }, { "from": "gpt", "value": "<think>\n\n</thi...
99f7db6e06813f09c307a89d139bf640
1
[ [ 427, 640 ] ]
[ "890b76360cd9b3b3" ]
General
A-OKVQA
[ "General" ]
[ "Honey-Data-15M-Rollout1", "Honey-Data-15M-Rollout2", "Honey-Data-15M-Rollout3" ]
[ "A-OKVQA", "aokvqa_cauldron_llava_format" ]
[ { "id": "3b343510dea7456173ed0a091bdce870", "ori_id": "cauldron/aokvqa/images/aokvqa_00015460.png", "subset": "A-OKVQA", "messages": [ { "from": "human", "value": "<image>\nWhat is the man swinging?" }, { "from": "gpt", "value": "<think>\n\n</think>\...
f1e25a9ae4fab4444cc9918d19774dd8
1
[ [ 480, 640 ] ]
[ "e1d87e263f3d1288" ]
General
A-OKVQA
[ "General" ]
[ "Honey-Data-15M-Rollout1", "Honey-Data-15M-Rollout2" ]
[ "A-OKVQA", "aokvqa_cauldron_llava_format" ]
[ { "id": "ced42eef0f0b8d2fd5d06adb74bce8de", "ori_id": "cauldron/aokvqa/images/aokvqa_00015475.png", "subset": "A-OKVQA", "messages": [ { "from": "human", "value": "<image>\nWhat color are the stripes on the side of the bathroom wall?" }, { "from": "gpt", ...
2701c0550613ac0d06d270c8fe219241
1
[ [ 640, 339 ] ]
[ "878d7c199b448e9b" ]
General
A-OKVQA
[ "General" ]
[ "Honey-Data-15M-Rollout1", "Honey-Data-15M-Rollout2", "Honey-Data-15M-Rollout3" ]
[ "A-OKVQA", "aokvqa_cauldron_llava_format" ]
[ { "id": "a1d719676525723607974c0176f1971f", "ori_id": "cauldron/aokvqa/images/aokvqa_00015476.png", "subset": "A-OKVQA", "messages": [ { "from": "human", "value": "<image>\nWhat is the white appliance used for?" }, { "from": "gpt", "value": "<think>\...
45fffba2488354e9318a655c02f9a6af
1
[ [ 361, 640 ] ]
[ "db0a52370bccfd84" ]
General
A-OKVQA
[ "General" ]
[ "Honey-Data-15M-Rollout1", "Honey-Data-15M-Rollout2" ]
[ "A-OKVQA", "aokvqa_cauldron_llava_format" ]
[ { "id": "2a4ae814d816641d741bdd0034c3adff", "ori_id": "cauldron/aokvqa/images/aokvqa_00015486.png", "subset": "A-OKVQA", "messages": [ { "from": "human", "value": "<image>\nIn what country would you find this type of cuisine?" }, { "from": "gpt", "va...
829bd6dea82941415dff21d4831bb9be
1
[ [ 640, 427 ] ]
[ "fa43e0f8b3506bb0" ]
General
A-OKVQA
[ "General" ]
[ "Honey-Data-15M-Rollout1", "Honey-Data-15M-Rollout2", "Honey-Data-15M-Rollout3" ]
[ "A-OKVQA", "aokvqa_cauldron_llava_format" ]
[ { "id": "30f7b0726cbda7eb9fa594045b682052", "ori_id": "cauldron/aokvqa/images/aokvqa_00015494.png", "subset": "A-OKVQA", "messages": [ { "from": "human", "value": "<image>\nWhat term is appropriate to describe this animal?" }, { "from": "gpt", "value...
2390078eb2ee196510830f0a951a4fcc
1
[ [ 480, 640 ] ]
[ "dc66bee29178e411" ]
General
A-OKVQA
[ "General" ]
[ "Honey-Data-15M-Rollout1", "Honey-Data-15M-Rollout2", "Honey-Data-15M-Rollout3" ]
[ "A-OKVQA", "aokvqa_cauldron_llava_format" ]
[ { "id": "c1a04e61f4f9dced5e5749cabb303496", "ori_id": "cauldron/aokvqa/images/aokvqa_00015495.png", "subset": "A-OKVQA", "messages": [ { "from": "human", "value": "<image>\nWhat is the brown and white animal doing with its neck in the air?" }, { "from": "gpt...
f1cf5a1976486274827ff93f33392ab0
1
[ [ 427, 640 ] ]
[ "bc3073644e8d339d" ]
General
A-OKVQA
[ "General" ]
[ "Honey-Data-15M-Rollout1", "Honey-Data-15M-Rollout2", "Honey-Data-15M-Rollout3" ]
[ "A-OKVQA", "aokvqa_cauldron_llava_format" ]
[ { "id": "6603037b9c4ea7a60ebc106050b0d36a", "ori_id": "cauldron/aokvqa/images/aokvqa_00015497.png", "subset": "A-OKVQA", "messages": [ { "from": "human", "value": "<image>\nWhat does the very large toy resemble?" }, { "from": "gpt", "value": "<think>...
f41fc461d7d14be22df7f1c7761378da
1
[ [ 500, 375 ] ]
[ "f6f0c10a7f3c20ab" ]
General
A-OKVQA
[ "General" ]
[ "Honey-Data-15M-Rollout1", "Honey-Data-15M-Rollout2", "Honey-Data-15M-Rollout3" ]
[ "A-OKVQA", "aokvqa_cauldron_llava_format" ]
[ { "id": "60c21d869a1df167227d872a5952197c", "ori_id": "cauldron/aokvqa/images/aokvqa_00015501.png", "subset": "A-OKVQA", "messages": [ { "from": "human", "value": "<image>\nWhat is the purpose of the black and silver square appliance?" }, { "from": "gpt", ...
9dba7b6e9db7e0d0afa7b45c394ca8c6
1
[ [ 640, 360 ] ]
[ "c6c6da9b191dc495" ]
General
A-OKVQA
[ "General" ]
[ "Honey-Data-15M-Rollout1", "Honey-Data-15M-Rollout2", "Honey-Data-15M-Rollout3" ]
[ "A-OKVQA", "aokvqa_cauldron_llava_format" ]
[ { "id": "c68162264721fac74e63d7fda7e101b3", "ori_id": "cauldron/aokvqa/images/aokvqa_00015505.png", "subset": "A-OKVQA", "messages": [ { "from": "human", "value": "<image>\nWhat are the animals near?" }, { "from": "gpt", "value": "<think>\n\n</think>...
6a046a0723483e3144e58b1f9fb2eb67
1
[ [ 500, 375 ] ]
[ "931f72e42b703c87" ]
General
A-OKVQA
[ "General" ]
[ "Honey-Data-15M-Rollout1", "Honey-Data-15M-Rollout2" ]
[ "A-OKVQA", "aokvqa_cauldron_llava_format" ]
[ { "id": "6bd9c3f6625650ba5ebea82e1f211cc2", "ori_id": "cauldron/aokvqa/images/aokvqa_00015511.png", "subset": "A-OKVQA", "messages": [ { "from": "human", "value": "<image>\nWhat color is the netting on this purse?" }, { "from": "gpt", "value": "<thin...
110fde0803761b89961d9b970012e694
1
[ [ 612, 612 ] ]
[ "c06651e97bd16197" ]
General
A-OKVQA
[ "General" ]
[ "Honey-Data-15M-Rollout1", "Honey-Data-15M-Rollout2", "Honey-Data-15M-Rollout3" ]
[ "A-OKVQA", "aokvqa_cauldron_llava_format" ]
[ { "id": "42ebe87808ff69c8a1bcd6aad962888d", "ori_id": "cauldron/aokvqa/images/aokvqa_00015512.png", "subset": "A-OKVQA", "messages": [ { "from": "human", "value": "<image>\nWhat is in the white cup?" }, { "from": "gpt", "value": "<think>\n\n</think>\...
7ffb649cf7254419449aedf73cb5d77f
1
[ [ 640, 540 ] ]
[ "e9cb961469e99c34" ]
General
A-OKVQA
[ "General" ]
[ "Honey-Data-15M-Rollout1", "Honey-Data-15M-Rollout2", "Honey-Data-15M-Rollout3" ]
[ "A-OKVQA", "aokvqa_cauldron_llava_format" ]
[ { "id": "70906d9f0bbaf2ef5db63b1b86116aa6", "ori_id": "cauldron/aokvqa/images/aokvqa_00015514.png", "subset": "A-OKVQA", "messages": [ { "from": "human", "value": "<image>\nWhat is near the water?" }, { "from": "gpt", "value": "<think>\n\n</think>\n\...
2b96059a5d8ec041871c258d184be06a
1
[ [ 640, 480 ] ]
[ "819a77e2159cf06b" ]
General
A-OKVQA
[ "General" ]
[ "Honey-Data-15M-Rollout1", "Honey-Data-15M-Rollout2" ]
[ "A-OKVQA", "aokvqa_cauldron_llava_format" ]
[ { "id": "6e01c9447ee8a7b16e2c4e81b9118e83", "ori_id": "cauldron/aokvqa/images/aokvqa_00015516.png", "subset": "A-OKVQA", "messages": [ { "from": "human", "value": "<image>\nWhat is the name of the operating system for both of these computers?" }, { "from": "...
21a80393c77b51a1349ea903a22afc45
1
[ [ 640, 429 ] ]
[ "c34be18d6e9768c1" ]
General
A-OKVQA
[ "General" ]
[ "Honey-Data-15M-Rollout1", "Honey-Data-15M-Rollout2", "Honey-Data-15M-Rollout3" ]
[ "A-OKVQA", "aokvqa_cauldron_llava_format" ]
[ { "id": "f0597d3a9489df439babe12d26dd04db", "ori_id": "cauldron/aokvqa/images/aokvqa_00015518.png", "subset": "A-OKVQA", "messages": [ { "from": "human", "value": "<image>\nWhich animals are near the trees?" }, { "from": "gpt", "value": "<think>\n\n<...
e4fed498cce3577e823bbdb216fdc0c6
1
[ [ 640, 429 ] ]
[ "b8629d8756b54aac" ]
General
A-OKVQA
[ "General" ]
[ "Honey-Data-15M-Rollout1", "Honey-Data-15M-Rollout2", "Honey-Data-15M-Rollout3" ]
[ "A-OKVQA", "aokvqa_cauldron_llava_format" ]
[ { "id": "a90b3c1794cc356b8abde7880893c595", "ori_id": "cauldron/aokvqa/images/aokvqa_00015524.png", "subset": "A-OKVQA", "messages": [ { "from": "human", "value": "<image>\nHow many bottles of wine are to the right in front to the man who is cutting the pizza?" }, {...
8246be8b630417c44918fcba766ecdf4
1
[ [ 640, 480 ] ]
[ "e5c8d2646413dafc" ]
General
A-OKVQA
[ "General" ]
[ "Honey-Data-15M-Rollout1", "Honey-Data-15M-Rollout2", "Honey-Data-15M-Rollout3" ]
[ "A-OKVQA", "aokvqa_cauldron_llava_format" ]
[ { "id": "62399362b755fcc981502a2bdd4b285a", "ori_id": "cauldron/aokvqa/images/aokvqa_00015534.png", "subset": "A-OKVQA", "messages": [ { "from": "human", "value": "<image>\nHow many people are in wetsuits standing before the crashing wave?" }, { "from": "gpt...
6a31cf06b30f1694954fe7cc2b03218e
1
[ [ 396, 640 ] ]
[ "c9d59fef6420292c" ]
General
A-OKVQA
[ "General" ]
[ "Honey-Data-15M-Rollout1", "Honey-Data-15M-Rollout2", "Honey-Data-15M-Rollout3" ]
[ "A-OKVQA", "aokvqa_cauldron_llava_format" ]
[ { "id": "830f0fa7455d0f90c7d3fe766a16cf2d", "ori_id": "cauldron/aokvqa/images/aokvqa_00015543.png", "subset": "A-OKVQA", "messages": [ { "from": "human", "value": "<image>\nWhat has the big ears?" }, { "from": "gpt", "value": "<think>\n\n</think>\n\n...
692ff9728c4e1630c368cb31b81a7b74
1
[ [ 640, 480 ] ]
[ "f6c33213d05d9dd0" ]
General
A-OKVQA
[ "General" ]
[ "Honey-Data-15M-Rollout1", "Honey-Data-15M-Rollout2", "Honey-Data-15M-Rollout3" ]
[ "A-OKVQA", "aokvqa_cauldron_llava_format" ]
[ { "id": "12b3d4ba5d1c7bda694e6d4228ae584b", "ori_id": "cauldron/aokvqa/images/aokvqa_00015544.png", "subset": "A-OKVQA", "messages": [ { "from": "human", "value": "<image>\nWhat is the man looking at?" }, { "from": "gpt", "value": "<think>\n\n</think...
cf49f4f710c7cefea44635566d1893b8
1
[ [ 426, 640 ] ]
[ "c0c0cc7fbcec1366" ]
General
A-OKVQA
[ "General" ]
[ "Honey-Data-15M-Rollout1", "Honey-Data-15M-Rollout2" ]
[ "A-OKVQA", "aokvqa_cauldron_llava_format" ]
[ { "id": "d4f42d6997d9a198fdd7d32ba455d2cc", "ori_id": "cauldron/aokvqa/images/aokvqa_00015551.png", "subset": "A-OKVQA", "messages": [ { "from": "human", "value": "<image>\nWhat is next to the lamppost?" }, { "from": "gpt", "value": "<think>\n\n</thi...
5c01737538f4a4d633dffaf203da00fa
1
[ [ 639, 640 ] ]
[ "f33e0e8c91d87871" ]
General
A-OKVQA
[ "General" ]
[ "Honey-Data-15M-Rollout1", "Honey-Data-15M-Rollout2" ]
[ "A-OKVQA", "aokvqa_cauldron_llava_format" ]
[ { "id": "02eda7673e0f51f4c05c3f8d6a3e9678", "ori_id": "cauldron/aokvqa/images/aokvqa_00015557.png", "subset": "A-OKVQA", "messages": [ { "from": "human", "value": "<image>\nWhat type of bird is on the street?" }, { "from": "gpt", "value": "<think>\n\...
End of preview. Expand in Data Studio

Honey-Data-V2

A multimodal supervised fine-tuning corpus of 19,707,852 image groups carrying 44,295,078 conversations, spread over 8 task categories and 420 subsets (5.81 TB).

Honey-Data-V2 extends Honey-Data-15M, the corpus behind Bee-8B. The original pool was re-curated under stricter structural rules, re-annotated by an upgraded stack of frontier models that contributes up to three independent answers per instruction, and extended with newly released community corpora.

One record is one image group

Unlike the usual one-row-per-conversation layout, a record here collects every conversation that refers to the same image. The image bytes are therefore stored once, no matter how many dialogues discuss it. Across the corpus this is the difference between 19,708,047 stored images and the 44,295,078 conversations that use them.

from datasets import load_dataset, get_dataset_config_names

subsets = get_dataset_config_names("HoneyDataV2/Honey-Data-V2")
ds = load_dataset("HoneyDataV2/Honey-Data-V2", subsets[0], split="train")

rec = ds[0]
rec["images"][0]                    # a PIL image
len(rec["data"])                    # how many dialogues share it
rec["data"][0]["messages"]          # [{'from': 'human', 'value': ...}, {'from': 'gpt', 'value': ...}]
rec["data"][0]["provenance"]        # which model wrote and which verified this answer

Image encoding

Images are stored as lossless WebP. Where the source was already JPEG, or where WebP came out larger than the original, the original bytes are kept untouched. WebP holds the same pixels as the PNGs it replaces in roughly 60% of the bytes. Decoding is transparent: datasets returns PIL images either way.

For RGBA images the alpha channel is preserved exactly and RGB is preserved wherever alpha > 0. PNG stores arbitrary colour under fully transparent pixels and WebP does not carry it over; no reader can observe those values.

Record fields

column type meaning
id string identifier of the image group
images list of image the images, decoded to PIL by datasets
n_images int32 how many images the group holds
image_sizes list of [width, height] pixel dimensions, one pair per image
image_phashes list of string perceptual hash, one per image
category string task category; matches the directory
source_subset string subset; matches the directory
categories list of string every category label the upstream corpora gave this group
sources list of string every upstream corpus that contributed a dialogue
source_subsets list of string every upstream subset name
data list of struct the dialogues, below

Each element of data:

field meaning
id, ori_id identifiers of this dialogue and of the record it came from
messages the dialogue as from / value pairs, human and gpt
n_turns number of turns
cot_level short or long chain-of-thought
original_answers the answers before rewriting
provenance which model performed each step
source, subset, source_subset, category where this dialogue came from

provenance names the model used at each stage, so a subset of the corpus can be selected by annotator: question_image_consist (the image-question consistency check), answer_rewrite, reasoning_rewrite, and answer_consist (verification of the rewritten answer). A value of null means that stage did not apply — determinate tasks such as OCR transcription and box-level grounding are filtered but never rewritten.

Composition

category subsets image groups conversations size
Caption 13 1,413,122 2,011,253 1.21 TB
Chart 77 4,665,363 11,036,064 0.87 TB
Document 49 2,271,245 4,766,060 0.67 TB
GUI-Grounding 4 500,916 2,803,848 0.12 TB
General 122 4,298,102 12,952,088 1.75 TB
Grounding 27 1,979,196 3,435,355 0.75 TB
OCR 45 2,564,793 3,625,483 0.37 TB
STEM 83 2,015,115 3,664,927 0.07 TB
total 420 19,707,852 44,295,078 5.81 TB

A subset name that appears in more than one category is qualified with its category, for example Chart-CoSyn and Document-CoSyn.

Provenance of the answers

stage models
answer rewriting Qwen3-VL-235B-A22B-Instruct, Kimi-K2.5, MAI-UI-8B
reasoning rewriting Qwen3-VL-235B-A22B-Thinking, Kimi-K2.5, Doubao-Thinking
image-question consistency Qwen3-VL-30B-A3B-Instruct
answer verification Qwen3-235B-A22B-Instruct

sources records which annotation pass a dialogue belongs to: Honey-Data-15M-Rollout1 is the re-curated original pool, Rollout2 and Rollout3 are the two further independent passes over the same instructions. Dialogues taken from newly incorporated community corpora carry that corpus's name instead.

Licensing information

Honey-Data-V2 aggregates many publicly available datasets, each governed by its own licence. Anyone using this corpus must observe the licence attached to each constituent dataset. To the extent we hold any rights in the curation and the generated answers, those are released under CC-BY-4.0.

Citation

@inproceedings{zhang2026bee,
  title     = {Bee: A High-Quality Corpus and Full-Stack Suite to Unlock Advanced Fully Open MLLMs},
  author    = {Yi Zhang and Bolin Ni and Xin-Sheng Chen and Hengrui Zhang and Yongming Rao and
               Houwen Peng and Qinglin Lu and Han Hu and Meng-Hao Guo and Shi-min Hu},
  booktitle = {The Fourteenth International Conference on Learning Representations},
  year      = {2026},
}
Downloads last month
48,720

Space using HoneyDataV2/Honey-Data-V2 1