SSD-Control: Spatially Controllable Generation with Mamba-2 Diffusion Backbones

Key Points

• The research aims to develop SSD-Control, a framework for controllable image and video generation using Mamba-2 diffusion backbones.
• Introduced Zero-Projection SSD Adapters
• Employed Condition-Injected State Modulation
• Focused on generating depth, pose, and edge-conditioned outputs
• Maintained O(LN) linear complexity during operations
• Facilitated effective image and video generation based on specific conditions
• Achieved improvements in controllability without compromising efficiency
• Demonstrated successful integration of controllable features with existing diffusion technologies