{"id":43620,"date":"2025-05-19T15:47:59","date_gmt":"2025-05-19T07:47:59","guid":{"rendered":"https:\/\/www.hkmu.edu.hk\/st\/?p=43620"},"modified":"2025-05-19T16:23:13","modified_gmt":"2025-05-19T08:23:13","slug":"crant-talk-series-generative-ai-empowered-3d-human-pose-tracking","status":"publish","type":"post","link":"https:\/\/www.hkmu.edu.hk\/st\/events\/crant-talk-series-generative-ai-empowered-3d-human-pose-tracking\/","title":{"rendered":"CRANT Talk Series: Generative AI-empowered 3D human pose tracking"},"content":{"rendered":"\t\t
\n\t\t\t\t\t\t\t
\n\t\t\t\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\n\t
\n\t\t
\n\t\t\t\n\t\t\t\n\t\t\t\t\t\t\t\t\t\n\t\t\t\tSpeaker: Professor Shiwen Mao, IEEE Fellow, Auburn University, USA
Organizer: CRANT, S&T, HKMU
Date: 18 Aug 2025 (Monday)
Time: 10:30 AM \u2013 12:00 PM
Location: D0818, Jockey Club Campus (JCC), HKMU\t\t\t<\/span>\n\t\t\t\t\n\t\t\t\t\t\t\t\t<\/h6>\n\t<\/div>\n\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t

Title<\/strong><\/em><\/p>

Generative AI-empowered 3D human pose tracking<\/p>

Abstract<\/strong><\/p>

In recent years, 3D human activity recognition and tracking has become an important topic in human-computer interaction. To preserve the privacy of users, there is considerable interest in techniques without using a video camera. In this talk, we first present RFID-Pose, a vision-assisted 3D human pose estimation system based on deep learning (DL), as well as its variations with enhanced generalizability to unseen test subjects and environments. The performance of DL models depends on the availability of sufficient high-quality radio frequency (RF) data, which is more difficult and expensive to collect than other types of data. To overcome this obstacle, in the second part of this talk, we present generative AI approaches to generate labeled synthetic RF data for multiple wireless sensing platforms, such as WiFi, RFID, and mmWave radar, including a conditional Recurrent Generative Adversarial Network (R-GAN) approach and diffusion\/latent diffusion based approaches. Finally, we propose a novel framework that leverages latent diffusion transformers to synthesize high quality RF data. This synthetic data augments limited datasets, enabling the training of a subject-adaptive transformer-based kinematics predictor to estimate 3D poses with temporal smoothness from RFID data. Additionally, we introduce a latent diffusion transformer with cross-attention conditioning to accurately infer missing joints in skeletal poses, completing full 25-joint configurations from partial (i.e., 12-joint) inputs. This is the first method to detect 20+ distinct skeletal joints using Generative-AI for RF sensing-based continuous 3D human pose estimation (HPE).<\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t

\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t

Biographies<\/strong><\/em><\/p>

Shiwen Mao is a Professor and Earle C. Williams Eminent Scholar and Director of the Wireless Engineering Research and Education Center at Auburn University. Dr. Mao’s research interest includes wireless networks, multimedia communications, RF sensing and IoT, smart health, and smart grid. He is the editor-in-chief of IEEE Transactions on Cognitive Communications and Networking, a member-at-large on the Board of Governors of IEEE Communications Society, and Vice President of Technical Activities of IEEE Council on Radio Frequency Identification (CRFID). He is a co-recipient of several technical and service awards from the IEEE. He is a Fellow of the IEEE.<\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t

\n\t\t\t
\n\t\t\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\"\"\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t","protected":false},"excerpt":{"rendered":"

Speaker: Professor Shiwen Mao, IEEE Fellow, Auburn University, USAOrganizer: CRANT, S&T, HKMUDate: 18 Aug 2025 (Monday)Time: 10:30 AM \u2013 12:00 PMLocation: D0818, Jockey Club Campus (JCC), HKMU TitleGenerative AI-empowered 3D human pose trackingAbstractIn recent years, 3D human activity recognition and tracking has become an important topic in human-computer interaction. To preserve the privacy of users,...<\/p>\n","protected":false},"author":542,"featured_media":31741,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_expiration-date-status":"","_expiration-date":0,"_expiration-date-type":"","_expiration-date-categories":[],"_expiration-date-options":[]},"categories":[44],"tags":[],"yoast_head":"\nCRANT Talk Series: Generative AI-empowered 3D human pose tracking - School of Science and Technology - Hong Kong Metropolitan University<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.hkmu.edu.hk\/st\/events\/crant-talk-series-generative-ai-empowered-3d-human-pose-tracking\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"CRANT Talk Series: Generative AI-empowered 3D human pose tracking\" \/>\n<meta property=\"og:description\" content=\"Speaker: Professor Shiwen Mao, IEEE Fellow, Auburn University, USAOrganizer: CRANT, S&T, HKMUDate: 18 Aug 2025 (Monday)Time: 10:30 AM \u2013 12:00\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.hkmu.edu.hk\/st\/events\/crant-talk-series-generative-ai-empowered-3d-human-pose-tracking\/\" \/>\n<meta property=\"og:site_name\" content=\"School of Science and Technology - Hong Kong Metropolitan University\" \/>\n<meta property=\"article:published_time\" content=\"2025-05-19T07:47:59+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2025-05-19T08:23:13+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.hkmu.edu.hk\/st\/wp-content\/uploads\/sites\/25\/2023\/03\/Artificial-Intelligence.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1500\" \/>\n\t<meta property=\"og:image:height\" content=\"1000\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"KE\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"KE\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"CRANT Talk Series: Generative AI-empowered 3D human pose tracking - School of Science and Technology - Hong Kong Metropolitan University","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.hkmu.edu.hk\/st\/events\/crant-talk-series-generative-ai-empowered-3d-human-pose-tracking\/","og_locale":"en_US","og_type":"article","og_title":"CRANT Talk Series: Generative AI-empowered 3D human pose tracking","og_description":"Speaker: Professor Shiwen Mao, IEEE Fellow, Auburn University, USAOrganizer: CRANT, S&T, HKMUDate: 18 Aug 2025 (Monday)Time: 10:30 AM \u2013 12:00","og_url":"https:\/\/www.hkmu.edu.hk\/st\/events\/crant-talk-series-generative-ai-empowered-3d-human-pose-tracking\/","og_site_name":"School of Science and Technology - Hong Kong Metropolitan University","article_published_time":"2025-05-19T07:47:59+00:00","article_modified_time":"2025-05-19T08:23:13+00:00","og_image":[{"width":1500,"height":1000,"url":"https:\/\/www.hkmu.edu.hk\/st\/wp-content\/uploads\/sites\/25\/2023\/03\/Artificial-Intelligence.jpg","type":"image\/jpeg"}],"author":"KE","twitter_card":"summary_large_image","twitter_misc":{"Written by":"KE","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.hkmu.edu.hk\/st\/events\/crant-talk-series-generative-ai-empowered-3d-human-pose-tracking\/","url":"https:\/\/www.hkmu.edu.hk\/st\/events\/crant-talk-series-generative-ai-empowered-3d-human-pose-tracking\/","name":"CRANT Talk Series: Generative AI-empowered 3D human pose tracking - School of Science and Technology - Hong Kong Metropolitan University","isPartOf":{"@id":"https:\/\/www.hkmu.edu.hk\/st\/#website"},"datePublished":"2025-05-19T07:47:59+00:00","dateModified":"2025-05-19T08:23:13+00:00","author":{"@id":"https:\/\/www.hkmu.edu.hk\/st\/#\/schema\/person\/865fdf30243c3d02875ae38843829962"},"breadcrumb":{"@id":"https:\/\/www.hkmu.edu.hk\/st\/events\/crant-talk-series-generative-ai-empowered-3d-human-pose-tracking\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.hkmu.edu.hk\/st\/events\/crant-talk-series-generative-ai-empowered-3d-human-pose-tracking\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.hkmu.edu.hk\/st\/events\/crant-talk-series-generative-ai-empowered-3d-human-pose-tracking\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"School of Science and Technology","item":"\/st\/"},{"@type":"ListItem","position":2,"name":"CRANT Talk Series: Generative AI-empowered 3D human pose tracking"}]},{"@type":"WebSite","@id":"https:\/\/www.hkmu.edu.hk\/st\/#website","url":"https:\/\/www.hkmu.edu.hk\/st\/","name":"School of Science and Technology - Hong Kong Metropolitan University","description":"School of Science and Technology - Hong Kong Metropolitan University","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.hkmu.edu.hk\/st\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.hkmu.edu.hk\/st\/#\/schema\/person\/865fdf30243c3d02875ae38843829962","name":"KE","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.hkmu.edu.hk\/st\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/438aeecd224e83780ddf6657506f43cd?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/438aeecd224e83780ddf6657506f43cd?s=96&d=mm&r=g","caption":"KE"},"url":"https:\/\/www.hkmu.edu.hk\/st\/author\/pkytam\/"}]}},"_links":{"self":[{"href":"https:\/\/www.hkmu.edu.hk\/st\/wp-json\/wp\/v2\/posts\/43620"}],"collection":[{"href":"https:\/\/www.hkmu.edu.hk\/st\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.hkmu.edu.hk\/st\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.hkmu.edu.hk\/st\/wp-json\/wp\/v2\/users\/542"}],"replies":[{"embeddable":true,"href":"https:\/\/www.hkmu.edu.hk\/st\/wp-json\/wp\/v2\/comments?post=43620"}],"version-history":[{"count":7,"href":"https:\/\/www.hkmu.edu.hk\/st\/wp-json\/wp\/v2\/posts\/43620\/revisions"}],"predecessor-version":[{"id":43633,"href":"https:\/\/www.hkmu.edu.hk\/st\/wp-json\/wp\/v2\/posts\/43620\/revisions\/43633"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.hkmu.edu.hk\/st\/wp-json\/wp\/v2\/media\/31741"}],"wp:attachment":[{"href":"https:\/\/www.hkmu.edu.hk\/st\/wp-json\/wp\/v2\/media?parent=43620"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.hkmu.edu.hk\/st\/wp-json\/wp\/v2\/categories?post=43620"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.hkmu.edu.hk\/st\/wp-json\/wp\/v2\/tags?post=43620"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}