Justin Manweiler  Justin Manweiler photo       

contact information

Research Staff Member
Thomas J. Watson Research Center, Yorktown Heights, NY USA


Professional Associations

Professional Associations:  ACM

Low Bandwidth Offload for Mobile AR

Environmental fingerprinting has been proposed as a key enabler to immersive, highly contextualized mobile computing applications, especially augmented reality. Our system VisualPrint, proposes a means to offload only the most distinctive visual data, that is, only those visual signatures which stand a good chance to yield a unique match. VisualPrint enables cloud-offloaded visual fingerprinting with efficacy comparable to using whole images, but with an order reduction in network transfer.
[ACM CoNEXT 2016]

Tracking Drone Orientation with Multiple GPS Receivers

Inertial sensors continuously track the 3D orientation of a flying drone, serving as the bedrock for maneuvers and stabilization. However, even the best inertial measurement units (IMU) are prone to various types of correlated failures. We consider using multiple GPS receivers on the drone as a failsafe mechanism for IMU failures. The core challenge is in accurately computing the relative locations between each receiver pair, and translating these measurements into the drone’s 3D orientation. 
[ACM MobiCom 2016]

OverLay: Practical Mobile Augmented Reality

What does it take to enable augmented reality (AR) on smartphones today? To build a ready-to-use mobile AR system, we adopt a top-down approach cutting across smartphone sensing, computer vision, cloud offloading, and linear optimization. Our core contribution is in a novel location-free geometric representation of the environment — from smartphone sensors — and using this geometry to prune down the visual search space.
[ACM MobiSys 2015]

Scalable Social Analytics for Live Viral Event Prediction

Large-scale, predictive social analytics have proven effective -- e.g., influence analysis, belief propagation, epidemic spread, sentiment mining, and behavior analysis. However, most efforts are not ready for practical, real-time deployment. We propose the CrowdCast platform for real-time temporal analysis and inference from streaming social data. We demonstrate live, accurate predictions of little-known YouTube videos soon to become viral in the next few hours.

Clustering Crowdsourced Videos by Line-of-Sight

Crowdsourced video, while often providing engaging and diverse perspectives not captured by professional videographers, can be difficult to organize. While manual indexing can be effective for popular, well-established videos, newer content may be poorly searchable; live video need not apply. We envisage video-sharing services for live user video streams, indexed automatically and in realtime, especially by shared content. We propose FOCUS, for Hadoop-on-cloud video-analytics, leveraging visual, 3D model reconstruction and multimodal sensing to decipher and continuously track a video's line-of-sight. FOCUS recognizes shared content even when viewed from diverse angles and distances. In a 70-volunteer user study, FOCUS' clustering correctness is roughly comparable to humans.
[ACM SenSys 2013]

Predicting Length of Stay at WiFi Hotspots

Today’s smartphones provide a variety of sensors, enabling high-resolution measurements of user behavior. We envision that many services can benefit from short-term predictions of complex human behavioral patterns. While enablement of behavior awareness through sensing is a broad research theme, one possibility is in predicting how quickly a person will move through a space. Within a space of moderate size, WiFi access points are uniquely positioned to track a statistical framework for user length of stay, passively recording metrics such as WiFI signal strength (RSSI) and potentially receiving client-uploaded sensor data. In this work, we attempt to quantity this opportunity, and show that human dwell time can be predicted with reasonable accuracy, even when restricted to passively observed WiFi RSSI.

An Object Positioning System using Smartphones

This project attempts to solve the following problem: can a distant project be localized by looking at it through a smartphone. We harness sensing on smartphones, combined with advances in computer vision, through a system called Object Positioning System that achieves reasonable localization accuracy. Our core technique uses computer vision to create an approximate 3D structure of the object and camera, and applies mobile phone sensors to scale and rotate the structure to its absolute configuration. Then, by solving (nonlinear) optimizations on the residual (scaling and rotation) error, we ultimately estimate the object's GPS position.
[ACM MobiSys 2012]

Monitoring the Health of Home Wireless Networks

Deploying home access points (AP) is hard. Untrained users typically purchase, install, and configure a home AP with very little awareness of wireless signal coverage and complex interference conditions. We envision a future of autonomous wireless network management that uses the Internet as an enabling technology. By leveraging a P2P architecture over wired Internet connections, nearby APs can coordinate to manage their shared wireless spectrum, especially in the face of network-crippling faults. As a specific instance of this architecture, we build RxIP, a network diagnostic and recovery tool, initially targeted towards hidden terminal mitigation.

Network Support for Energy Management on WiFi Smartphones

WiFi continues to be a prime source of energy consumption in mobile devices. WiFi network congestion (contention) among different network access points (APs) can dramatically increase a client's energy consumption. We design a system that achieves energy efficiency by evading inter-AP network contention. Our prototype provides immediate, no-change compatibility with all WiFi devices, yielding up to 2x battery life improvement under real-world traffic loads for the latest Android-based smartphones.
[ACM MobiSys 2011, IEEE Transactions on Mobile Computing]

Interactive Multiplayer Mobile Gaming over Cellular 3G

Supporting interactive multiplayer games on mobile phones over cellular networks is difficult. It will soon become essential, following the explosion of mostly single-player or turn-based games. Highly variable cellular link performance yields frequent failed games or unacceptably-slow network connections among players. We have built a scalable service for matchmaking in mobile games -- assigning players to games so that end-to-end latency requirements are met -- by learning the properties of each cellular link.
[ACM MobiSys 2011] 

Sensor Assisted Wireless Communication

The nature of human mobility demands that mobile devices become agile to diverse operating environments. Coping with such diversity requires the device to assess its environment, and trigger appropriate responses to each of them. While existing communication subsystems rely on in-band wireless signals for context-assessment and response, we explore a lateral approach of using out-of-band sensor information. We propose a relatively novel framework that synthesizes in-band and out-of-band information, facilitating more informed communication decisions.
[Invited Paper to IEEE LANMAN 2010]

Strong Location Privacy for Mobile Social Services

Conventional mobile social services rely on two classes of trusted relationships: participants trust a centralized server to manage their location information and trust between users is based on existing social relationships. These assumptions are not secure or general enough, especially given demonstrated and repeated failure of service providers to protect privacy-sensitive location data. We design a “missed-connections” mobile service which does not rely upon the central server to preserve data privacy.
[ACM HotMobile 2009, ACM CCS 2009]

Transmission Reordering in Wireless Networks

Modern wireless interfaces support a physical layer capability called Message in Message (MIM). Briefly, MIM allows a receiver to disengage from an ongoing reception, and engage onto a stronger incoming signal. Links that otherwise conflict (strongly interfere) with each other can be made concurrent with MIM, by initiating transmissions in a specific order. We design, build, and test an enhanced network system to exploit the opportunity in MIM-aware reordering, yielding dramatic throughput improvements.
[ACM HotNets 2008, ACM MobiCom 2009, IEEE/ACM Transactions on Networking 2011]