📝 Annotations#

We provide here some technical details about the format of the dataset and its annotations.

Shapes and styles#

The 3DCoMPaT++ dataset provides 10.009 shapes belonging to 42 distinct categories. We collect mesh annotations for each part instance of each shape, following a consistent nomenclature hand-defined for every shape category in the dataset.

Part annotations are carefully verified through a comprehensive quality checking process, and complemented with material annotations from a list of 13 coarse material categories. Material annotations are later used to sample from a list of 293 fine-grained materials belonging to the coarse categories, in order to generate stylized augmentations of our 3D dataset.

In order: render, part segmentation mask, materials mask, depth map.

Each stylized shape in the dataset is indexed by a code of the following format:

{hex_class_id}_{hex_model_id}__{style_id}

Where:

hex_class_id is a 2-digit hexadecimal code for the model’s shape category
hex_model_id is a 3-digit hexadecimal code for the model’s number within the category
style_id is a decimal number indicating the number of the material style augmentation (which we refer to asa composition), ranging from 0 to 1000.

Part annotations#

Comparing coarse-grained (left) with fine-grained (right) annotations.

Part annotations are provided for two semantic-levels: coarse-grained and fine-grained. Fine-grained part classes are defined from a hand-defined shape category-specific nomenclature, while coarse-grained part classes are defined as shape category-specific groupings of fine-grained parts.

For example, in the airplane shape category, the wheel, wheel_connector and wheel_cover fine-grained parts are all merged into the wheel coarse part:

    "airplane": {
        "...": "...",
        "wheel": "wheel",
        "wheel_connector": "wheel",
        "wheel_cover": "wheel"
    },

Shape categories in our dataset can share part names by default. Parts that are category specific and relevant to the category are prefixed by the name of the category (for example: airplane_wing).

We compare in the figure below the average number of unique parts per object, for fine and coarse semantic levels.

Average number of unique parts in fine (blue) and coarse (red) semantic levels.

Metadata#

We provide here the list of fine-grained and coarse-grained part classes, categories, and coarse materials used to generate our dataset.

Note

To access the complete metadata files, please refer to our GitHub repository:

Shape categories#

We provide here the list of the 42 shape categories in our dataset, alongside their name and index.

index	category
0	airplane
1	bag
2	basket
3	bbq_grill
4	bed
5	bench
6	bicycle
7	bird_house
8	boat
9	cabinet
10	candle_holder
11	car
12	chair
13	clock
14	coat_rack
15	curtain
16	dishwasher
17	dresser
18	fan
19	faucet
20	garbage_bin
21	gazebo
22	jug
23	ladder
24	lamp
25	love_seat
26	ottoman
27	parasol
28	planter
29	shelf
30	shower
31	sinks
32	skateboard
33	sofa
34	sports_table
35	stool
36	sun_lounger
37	table
38	toilet
39	tray
40	trolley
41	vase

Coarse-grained materials#

We provide here the list of the 13 coarse-grained materials in our dataset.

index	material
0	ceramic
1	fabric
2	glass
3	granite
4	leather
5	marble
6	metal
7	plant
8	plastic
9	rubber
10	soil
11	wax
12	wood

Coarse-grained parts#

We provide here the list of the 43 coarse part categories in our dataset, alongside their name and index.

index	part name
0	airplane_engine
1	armrest
2	backrest
3	base
4	bbq_cooking_grate
5	bed_board
6	bird_house_cage
7	bird_house_dispenser
8	blade
9	boat_sail
10	body
11	bulb
12	candle
13	car_seat
14	clock_hand
15	coat_rack_hanger
16	curtain
17	faucet
18	faucet_valve
19	handle
20	hook
21	horizontal_panel
22	ladder_rail
23	lamp_cover
24	lid
25	paddle
26	pillow
27	plant
28	pole
29	pool_ball
30	pool_cue
31	roof
32	seat
33	shower_head
34	shower_hose
35	sink
36	skateboard_truck
37	soil
38	step
39	support
40	vertical_panel
41	wheel
42	window

Fine-grained parts#

We provide here the list of the 275 coarse part categories in our dataset, alongside their name and index.

index	part name
0	aerator
1	airplane_body
2	airplane_door
3	airplane_engine_cowling
4	airplane_engine_fan
5	airplane_engine_propeller
6	airplane_engine_pylon
7	airplane_fairing
8	airplane_horizontal_stabilizer
9	airplane_vertical_stabilizer
10	airplane_window
11	airplane_wing
12	armrest
13	armrest_bar
14	armrest_connector
15	armrest_cushion
16	backrest
17	backrest_bar
18	backrest_connector
19	backrest_frame
20	bag_body
21	bag_buckle
22	bag_clip_buckle
23	bag_lobster_clasp
24	bag_strap
25	bag_zipper
26	basket_body
27	basket_lid
28	bbq_control_knob
29	bbq_cooking_grate
30	bed_duvet
31	bed_footboard
32	bed_footboard_connector
33	bed_footboard_frame
34	bed_frame
35	bed_headboard
36	bed_headboard_connector
37	bed_headboard_frame
38	bed_mattress
39	bed_sheet
40	bed_support
41	bicycle_back_derailleur
42	bicycle_brake
43	bicycle_brake_cable
44	bicycle_brake_lever
45	bicycle_brake_pad
46	bicycle_chain
47	bicycle_chain_stay
48	bicycle_chain_stay_connector
49	bicycle_down_tube
50	bicycle_fork
51	bicycle_front_derailleur
52	bicycle_gear
53	bicycle_handlebar
54	bicycle_head_tube
55	bicycle_pedal
56	bicycle_pedal_arm
57	bicycle_pedal_axle
58	bicycle_rim
59	bicycle_saddle
60	bicycle_seat_clamp
61	bicycle_seat_post
62	bicycle_seat_stay
63	bicycle_seat_tube
64	bicycle_spokes
65	bicycle_top_tube
66	bicycle_wheel
67	bird_house_cage
68	bird_house_feeder
69	bird_house_perch
70	bird_house_water_dispenser
71	boat_anchor
72	boat_body
73	boat_dashboard
74	boat_frame
75	boat_helm
76	boat_helm_connector
77	boat_keel
78	boat_ladder
79	boat_light
80	boat_mast
81	boat_motor
82	boat_motor_propeller
83	boat_paddle
84	boat_paddle_holder
85	boat_rudder
86	boat_sail
87	boat_side_cable
88	boat_side_cable_connector
89	boat_throttle_lever
90	boat_window
91	boat_windshield
92	bottom_frame
93	bulb
94	candle
95	candle_container
96	candle_holder_arm
97	candle_holder_connector
98	car_chassis
99	car_dashboard
100	car_door
101	car_door_frame
102	car_fender
103	car_front_bumper
104	car_gear_lever
105	car_grille
106	car_headlight
107	car_hood
108	car_number_plate
109	car_rear_bumper
110	car_rear_view_mirror
111	car_rear_window
112	car_roof
113	car_side_window
114	car_steering_wheel
115	car_taillight
116	car_trunk
117	car_wheel
118	car_windshield
119	car_wiper
120	channel
121	clock_battery_box
122	clock_body
123	clock_frame
124	clock_hand_axis
125	clock_hour_hand
126	clock_minute_hand
127	clock_number
128	clock_pendulum
129	clock_second_hand
130	coat_rack_hanger
131	coat_rack_hanger_knob
132	coat_rack_umbrella_stand
133	curtain
134	curtain_hook
135	curtain_pole
136	curtain_pole_cover
137	curtain_tieback
138	design
139	dishwasher_button
140	door
141	drawer
142	fan_blade
143	fan_blade_bracket
144	fan_downrod
145	fan_downrod_connector
146	fan_light
147	fan_motor_box
148	faucet_body
149	faucet_connector
150	faucet_lever
151	faucet_spout
152	faucet_valve
153	fence_panel
154	finial
155	foot
156	footrest
157	frame
158	front_frame
159	garbage_bin_body
160	garbage_bin_lid
161	garbage_bin_lid_connector
162	garbage_bin_pedal
163	gazebo_pillar
164	gazebo_pillar_brace
165	gazebo_pillar_stretcher
166	glass_panel
167	handle
168	handle_connector
169	headrest
170	headrest_connector
171	hook
172	horizontal_bottom_panel
173	horizontal_panel
174	horizontal_top_panel
175	jug_body
176	jug_lid
177	jug_spout
178	keyboard_tray
179	knob
180	ladder_back_rail
181	ladder_front_rail
182	ladder_spreader
183	ladder_step
184	ladder_top_cap
185	lamp_arm
186	lamp_chain
187	lamp_chord
188	lamp_connector
189	lamp_cover
190	lamp_cover_frame
191	lamp_cover_glass
192	lamp_cover_holder
193	lamp_finial
194	lamp_hook
195	lamp_plug
196	lamp_pole
197	lamp_socket
198	lamp_support
199	lamp_switch
200	lamp_track
201	leg
202	lever
203	mirror
204	parasol_button
205	parasol_canopy
206	parasol_lock
207	parasol_long_rib
208	parasol_runner
209	parasol_short_rib
210	parasol_tie_wrap
211	pedestal
212	pillow
213	plant
214	planter_container
215	plate
216	pole
217	pool_ball
218	pool_cue
219	rivet
220	roof
221	roof_beam
222	roof_connector
223	seat
224	seat_connector
225	seat_frame
226	seat_support
227	shelf
228	shower_button
229	shower_connector
230	shower_head
231	shower_head_connector
232	shower_head_support
233	shower_hose
234	shower_nozzle
235	sink
236	sink_flange
237	sink_pipe
238	sink_stopper
239	sink_stubout
240	sink_trap
241	sink_unit
242	skateboard_deck
243	skateboard_grid_tape
244	skateboard_truck
245	soil
246	sports_table_cabinet
247	sports_table_corner_net
248	sports_table_corner_pocket
249	sports_table_cushion
250	sports_table_frame
251	stretcher
252	support
253	support_bar
254	toilet_bowl
255	toilet_flush_button
256	toilet_flush_handle
257	toilet_lid
258	toilet_seat
259	toilet_water_tank
260	toilet_water_tank_cover
261	top_connector
262	top_frame
263	vase_bracket
264	vase_container
265	vase_neck
266	vertical_back_panel
267	vertical_divider_panel
268	vertical_front_panel
269	vertical_side_panel
270	wall_mount
271	wheel
272	wheel_bearing
273	wheel_connector
274	wheel_cover