Causal representation learning, multimodal alignment, agentic decision systems.
Jorge Ortiz serves as Site Director and Principal Investigator for CRAIG, the NSF Center on Responsible AI & Governance, and Lead Site PI for the NSF Center for Smart Streetscapes (CS3). He directs the Sensing & Reasoning Lab at Rutgers University.
His group builds causal world models and agentic multimodal systems that integrate sensing, inference, and intervention for decision-making at scale across urban systems, sports analytics, and AI governance. The approach separates perception from reasoning. Multimodal encoders learn compact state representations from video, audio, IMU, and network data, while causal reasoning modules plan interventions and generate explanations.
Extract state from
sensor streams
Form hypotheses • plan interventions
adapt to conditions
Previously, I was at IBM Research and several startups applying machine learning to sensor-driven systems. I received my PhD in Computer Science from UC Berkeley and my BS from MIT.
Role: Site Director & PI (Rutgers)
Causal inference, accountability, and evaluation pipelines for trustworthy AI in public and enterprise deployments.
Role: Lead Site PI (Rutgers)
City-scale sensing and digital twins; causal reasoning for pedestrian safety and closed-loop actuation.
Role: Director
Agentic causal world models; multimodal perception→reasoning stack; interventional analysis and counterfactual simulation.
Role: Research Analyst
Biomechanics and strategy models from broadcast + sensor data; embeddings for outcomes; counterfactual search.
Interviewed about AI capabilities and the hype around superintelligence
Coverage of our CoRL 2022 research on socially-aware robot-assisted feeding that uses AI to monitor dining social cues and time food delivery appropriately during group meals.
In-depth exploration of multimodal learning across audio, video, time series, and language/text data, focusing on foundational concepts, advanced techniques, and practical applications for distributed sensing systems.
Comprehensive introduction to programming in C and C++ for ECE students, covering foundational concepts through advanced topics including object-oriented programming, modern C++ features, and multithreading.