{"id":30,"date":"2022-04-29T04:16:18","date_gmt":"2022-04-29T04:16:18","guid":{"rendered":"https:\/\/mscvprojects.ri.cmu.edu\/2022team14\/?page_id=30"},"modified":"2022-12-21T03:53:46","modified_gmt":"2022-12-21T03:53:46","slug":"home","status":"publish","type":"page","link":"https:\/\/mscvprojects.ri.cmu.edu\/2022team14\/","title":{"rendered":"Home"},"content":{"rendered":"\n

Description<\/h2>\n\n\n\n
\"\"
Visualization of the MOT problem<\/figcaption><\/figure>\n\n\n\n

Our researched based goal in this project was to advance the performance of Multi-Object Tracking (MOT) <\/strong>algorithms. The MOT problem is often formulated as the detection<\/em> and association<\/em> of multiple objects of interest across frames of a video feed. <\/p>\n\n\n\n

Motivation<\/h2>\n\n\n\n

MOT finds application across a variety of real world problems. In autonomous robotics, tracking objects across multiple frames allows a system to predict higher level statistics of the object over time, enabling forecasting and planning based on the prior path. MOT is also frequently used in security, where tracking a particular identity over time in a crowded scene is difficult to do manually. In analytics, we may want to count the number of unique objects in a scene. <\/p>\n\n\n\n

\"\"
Tracking for self driving, used for trajectory forecasting<\/figcaption><\/figure>\n\n\n\n

Generally speaking, MOT is important whenever we want to build a model of unique identities in a dynamic scene. <\/p>\n\n\n\n

MOT methods that jointly learn detection and association are supervised, requiring training on track annotations. Labeling both bounding boxes and their associated identities is an incredibly challenging and time consuming procedure, with most tracking benchmarks having only several short (<30 second) video clips. As a result, our aim in this project was to study MOT as an exclusively unsupervised problem where tracking labels are assumed to not be available – i.e. we follow the paradigm of tracking by<\/em> detection. We first train a detector on unassociated scenes labeled by only bounding boxes, then use hand-crafted heuristics to association these bounding boxes across time. <\/p>\n\n\n\n

\"\"
DeepSORT being applied for pedestrian tracking<\/figcaption><\/figure><\/div>\n\n\n\n

Problem Statement<\/h2>\n\n\n\n

Our aim in this project is to improve existing MOT algorithms by surpassing their performance on common benchmarks. We additionally ensure our algorithm is unsupervised (doesn’t use tracking ground truth) by following the tracking by detection paradigm and our algorithm is online (predicts each frame given only information of previous frames). <\/p>\n\n\n\n

\"\"<\/figure><\/div>\n\n\n\n

.<\/p>\n","protected":false},"excerpt":{"rendered":"

Description Our researched based goal in this project was to advance the performance of Multi-Object Tracking (MOT) algorithms. The MOT problem is often formulated as the detection and association of multiple objects of interest across frames of a video feed. Motivation MOT finds application across a variety of real world problems. In autonomous robotics, tracking … <\/p>\n

Continue reading “Home”<\/span><\/a><\/p>\n","protected":false},"author":142,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-30","page","type-page","status-publish","hentry"],"yoast_head":"\nHome - Unsupervised Online Human Detection and Tracking<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/mscvprojects.ri.cmu.edu\/2022team14\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Home - Unsupervised Online Human Detection and Tracking\" \/>\n<meta property=\"og:description\" content=\"Description Our researched based goal in this project was to advance the performance of Multi-Object Tracking (MOT) algorithms. The MOT problem is often formulated as the detection and association of multiple objects of interest across frames of a video feed. Motivation MOT finds application across a variety of real world problems. In autonomous robotics, tracking … Continue reading "Home"\" \/>\n<meta property=\"og:url\" content=\"https:\/\/mscvprojects.ri.cmu.edu\/2022team14\/\" \/>\n<meta property=\"og:site_name\" content=\"Unsupervised Online Human Detection and Tracking\" \/>\n<meta property=\"article:modified_time\" content=\"2022-12-21T03:53:46+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/mscvprojects.ri.cmu.edu\/2022team14\/wp-content\/uploads\/sites\/69\/2022\/12\/Screenshot-2022-12-20-at-10.14.08-PM-1024x434.jpg\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2022team14\\\/\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2022team14\\\/\",\"name\":\"Home - Unsupervised Online Human Detection and Tracking\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2022team14\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2022team14\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2022team14\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2022team14\\\/wp-content\\\/uploads\\\/sites\\\/69\\\/2022\\\/12\\\/Screenshot-2022-12-20-at-10.14.08-PM-1024x434.jpg\",\"datePublished\":\"2022-04-29T04:16:18+00:00\",\"dateModified\":\"2022-12-21T03:53:46+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2022team14\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2022team14\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2022team14\\\/#primaryimage\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2022team14\\\/wp-content\\\/uploads\\\/sites\\\/69\\\/2022\\\/12\\\/Screenshot-2022-12-20-at-10.14.08-PM-scaled.jpg\",\"contentUrl\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2022team14\\\/wp-content\\\/uploads\\\/sites\\\/69\\\/2022\\\/12\\\/Screenshot-2022-12-20-at-10.14.08-PM-scaled.jpg\",\"width\":2560,\"height\":1084},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2022team14\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2022team14\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Home\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2022team14\\\/#website\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2022team14\\\/\",\"name\":\"Unsupervised Online Human Detection and Tracking\",\"description\":\"Students - Adnan Ahmad, Gerard Maggiolino | Advisors - Kris Kitani (CMU), Rahul Nallamothu (Meta), Sam Pepose (Meta)| Sponsor - Meta \",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2022team14\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Home - Unsupervised Online Human Detection and Tracking","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/mscvprojects.ri.cmu.edu\/2022team14\/","og_locale":"en_US","og_type":"article","og_title":"Home - Unsupervised Online Human Detection and Tracking","og_description":"Description Our researched based goal in this project was to advance the performance of Multi-Object Tracking (MOT) algorithms. The MOT problem is often formulated as the detection and association of multiple objects of interest across frames of a video feed. Motivation MOT finds application across a variety of real world problems. In autonomous robotics, tracking … Continue reading \"Home\"","og_url":"https:\/\/mscvprojects.ri.cmu.edu\/2022team14\/","og_site_name":"Unsupervised Online Human Detection and Tracking","article_modified_time":"2022-12-21T03:53:46+00:00","og_image":[{"url":"https:\/\/mscvprojects.ri.cmu.edu\/2022team14\/wp-content\/uploads\/sites\/69\/2022\/12\/Screenshot-2022-12-20-at-10.14.08-PM-1024x434.jpg","type":"","width":"","height":""}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2022team14\/","url":"https:\/\/mscvprojects.ri.cmu.edu\/2022team14\/","name":"Home - Unsupervised Online Human Detection and Tracking","isPartOf":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2022team14\/#website"},"primaryImageOfPage":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2022team14\/#primaryimage"},"image":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2022team14\/#primaryimage"},"thumbnailUrl":"https:\/\/mscvprojects.ri.cmu.edu\/2022team14\/wp-content\/uploads\/sites\/69\/2022\/12\/Screenshot-2022-12-20-at-10.14.08-PM-1024x434.jpg","datePublished":"2022-04-29T04:16:18+00:00","dateModified":"2022-12-21T03:53:46+00:00","breadcrumb":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2022team14\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/mscvprojects.ri.cmu.edu\/2022team14\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2022team14\/#primaryimage","url":"https:\/\/mscvprojects.ri.cmu.edu\/2022team14\/wp-content\/uploads\/sites\/69\/2022\/12\/Screenshot-2022-12-20-at-10.14.08-PM-scaled.jpg","contentUrl":"https:\/\/mscvprojects.ri.cmu.edu\/2022team14\/wp-content\/uploads\/sites\/69\/2022\/12\/Screenshot-2022-12-20-at-10.14.08-PM-scaled.jpg","width":2560,"height":1084},{"@type":"BreadcrumbList","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2022team14\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/mscvprojects.ri.cmu.edu\/2022team14\/"},{"@type":"ListItem","position":2,"name":"Home"}]},{"@type":"WebSite","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2022team14\/#website","url":"https:\/\/mscvprojects.ri.cmu.edu\/2022team14\/","name":"Unsupervised Online Human Detection and Tracking","description":"Students - Adnan Ahmad, Gerard Maggiolino | Advisors - Kris Kitani (CMU), Rahul Nallamothu (Meta), Sam Pepose (Meta)| Sponsor - Meta ","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/mscvprojects.ri.cmu.edu\/2022team14\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2022team14\/wp-json\/wp\/v2\/pages\/30","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2022team14\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2022team14\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2022team14\/wp-json\/wp\/v2\/users\/142"}],"replies":[{"embeddable":true,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2022team14\/wp-json\/wp\/v2\/comments?post=30"}],"version-history":[{"count":13,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2022team14\/wp-json\/wp\/v2\/pages\/30\/revisions"}],"predecessor-version":[{"id":115,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2022team14\/wp-json\/wp\/v2\/pages\/30\/revisions\/115"}],"wp:attachment":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2022team14\/wp-json\/wp\/v2\/media?parent=30"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}