{"id":13,"date":"2026-04-25T14:09:46","date_gmt":"2026-04-25T14:09:46","guid":{"rendered":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf5\/?page_id=13"},"modified":"2026-04-25T14:13:16","modified_gmt":"2026-04-25T14:13:16","slug":"problem-statement","status":"publish","type":"page","link":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf5\/problem-statement\/","title":{"rendered":"Problem Statement"},"content":{"rendered":"\n

Based on input images from warehouses, the objective is to detect situations in which pallets and loads are potentially unsafe or abnormal. That means the algorithm needs to be able to recognize if there is a pallet, if there is a load, if the pallet is damaged, if the load is damaged, and if the image as a whole is abnormal.<\/p>\n\n\n

\n
\"\"
Example warehouse scene from inside a real KION warehouse<\/figcaption><\/figure>\n<\/div>\n\n\n

This problem is difficult due to the presence of high variation in pallet type, packaging material, camera angle, occlusion, lighting, and background clutter. There could also be a possibility of more than one pallet in a single image, which makes reasoning about the entire image very difficult.<\/p>\n\n\n\n

To address this, we formulate pallet anomaly detection as a structured visual reasoning problem. Instead of only detecting objects, the system must extract meaningful attributes from each detected region and aggregate them into an image-level safety decision.<\/p>\n\n\n

\n
\"\"<\/figure>\n<\/div>","protected":false},"excerpt":{"rendered":"

Based on input images from warehouses, the objective is to detect situations in which pallets and loads are potentially unsafe or abnormal. That means the algorithm needs to be able to recognize if there is a pallet, if there is a load, if the pallet is damaged, if the load is damaged, and if the … <\/p>\n

Continue reading “Problem Statement”<\/span><\/a><\/p>\n","protected":false},"author":273,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-13","page","type-page","status-publish","hentry"],"yoast_head":"\nProblem Statement - Grounded Vision-Language Understanding for Warehouse Automation<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf5\/problem-statement\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Problem Statement - Grounded Vision-Language Understanding for Warehouse Automation\" \/>\n<meta property=\"og:description\" content=\"Based on input images from warehouses, the objective is to detect situations in which pallets and loads are potentially unsafe or abnormal. That means the algorithm needs to be able to recognize if there is a pallet, if there is a load, if the pallet is damaged, if the load is damaged, and if the … Continue reading "Problem Statement"\" \/>\n<meta property=\"og:url\" content=\"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf5\/problem-statement\/\" \/>\n<meta property=\"og:site_name\" content=\"Grounded Vision-Language Understanding for Warehouse Automation\" \/>\n<meta property=\"article:modified_time\" content=\"2026-04-25T14:13:16+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf5\/wp-content\/uploads\/sites\/147\/2026\/04\/image-1.png\" \/>\n\t<meta property=\"og:image:width\" content=\"738\" \/>\n\t<meta property=\"og:image:height\" content=\"551\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2026teamf5\\\/problem-statement\\\/\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2026teamf5\\\/problem-statement\\\/\",\"name\":\"Problem Statement - Grounded Vision-Language Understanding for Warehouse Automation\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2026teamf5\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2026teamf5\\\/problem-statement\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2026teamf5\\\/problem-statement\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2026teamf5\\\/wp-content\\\/uploads\\\/sites\\\/147\\\/2026\\\/04\\\/image-1.png\",\"datePublished\":\"2026-04-25T14:09:46+00:00\",\"dateModified\":\"2026-04-25T14:13:16+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2026teamf5\\\/problem-statement\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2026teamf5\\\/problem-statement\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2026teamf5\\\/problem-statement\\\/#primaryimage\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2026teamf5\\\/wp-content\\\/uploads\\\/sites\\\/147\\\/2026\\\/04\\\/image-1.png\",\"contentUrl\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2026teamf5\\\/wp-content\\\/uploads\\\/sites\\\/147\\\/2026\\\/04\\\/image-1.png\",\"width\":738,\"height\":551},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2026teamf5\\\/problem-statement\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2026teamf5\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Problem Statement\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2026teamf5\\\/#website\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2026teamf5\\\/\",\"name\":\"Grounded Vision-Language Understanding for Warehouse Automation\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2026teamf5\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Problem Statement - Grounded Vision-Language Understanding for Warehouse Automation","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf5\/problem-statement\/","og_locale":"en_US","og_type":"article","og_title":"Problem Statement - Grounded Vision-Language Understanding for Warehouse Automation","og_description":"Based on input images from warehouses, the objective is to detect situations in which pallets and loads are potentially unsafe or abnormal. That means the algorithm needs to be able to recognize if there is a pallet, if there is a load, if the pallet is damaged, if the load is damaged, and if the … Continue reading \"Problem Statement\"","og_url":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf5\/problem-statement\/","og_site_name":"Grounded Vision-Language Understanding for Warehouse Automation","article_modified_time":"2026-04-25T14:13:16+00:00","og_image":[{"width":738,"height":551,"url":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf5\/wp-content\/uploads\/sites\/147\/2026\/04\/image-1.png","type":"image\/png"}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf5\/problem-statement\/","url":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf5\/problem-statement\/","name":"Problem Statement - Grounded Vision-Language Understanding for Warehouse Automation","isPartOf":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf5\/#website"},"primaryImageOfPage":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf5\/problem-statement\/#primaryimage"},"image":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf5\/problem-statement\/#primaryimage"},"thumbnailUrl":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf5\/wp-content\/uploads\/sites\/147\/2026\/04\/image-1.png","datePublished":"2026-04-25T14:09:46+00:00","dateModified":"2026-04-25T14:13:16+00:00","breadcrumb":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf5\/problem-statement\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/mscvprojects.ri.cmu.edu\/2026teamf5\/problem-statement\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf5\/problem-statement\/#primaryimage","url":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf5\/wp-content\/uploads\/sites\/147\/2026\/04\/image-1.png","contentUrl":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf5\/wp-content\/uploads\/sites\/147\/2026\/04\/image-1.png","width":738,"height":551},{"@type":"BreadcrumbList","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf5\/problem-statement\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf5\/"},{"@type":"ListItem","position":2,"name":"Problem Statement"}]},{"@type":"WebSite","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf5\/#website","url":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf5\/","name":"Grounded Vision-Language Understanding for Warehouse Automation","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf5\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf5\/wp-json\/wp\/v2\/pages\/13","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf5\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf5\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf5\/wp-json\/wp\/v2\/users\/273"}],"replies":[{"embeddable":true,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf5\/wp-json\/wp\/v2\/comments?post=13"}],"version-history":[{"count":3,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf5\/wp-json\/wp\/v2\/pages\/13\/revisions"}],"predecessor-version":[{"id":19,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf5\/wp-json\/wp\/v2\/pages\/13\/revisions\/19"}],"wp:attachment":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf5\/wp-json\/wp\/v2\/media?parent=13"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}