I am seeking a high-level AI Automation Architect to build a fully automated (or semi-automated) content creation pipeline for a home decor brand specializing in Table and Floor Lamps. The goal is to bypass manual content creation by using an orchestrator to generate 100% AI-driven lifestyle assets.
The Core Challenge: Most AI workflows “hallucinate” or warp product shapes. This project requires a “Preservation Strategy” where the lamp is treated as an immutable foreground layer—its pixels are never re-generated. Additionally, the system must master lighting physics, ensuring the lamp acts as the primary light source with realistic shadows, glow, and light spill.
Key Responsibilities & Workflow Design: You will be responsible for building a Make.com orchestration layer that connects the following stages:
1. Intake & Segmentation: Triggered by a photo upload, the system must use Photoroom API or SAM 2 to generate high-res transparent cutouts and binary masks.
2. Scene Generation (The “Room Plate”): Using ComfyUI (SDXL or FLUX), the system must generate a “cozy, moody, cinematic” background room while leaving an empty space for the product.
3. Lighting Integration Pass: A crucial two-pass process. After compositing the lamp, the system must run a masked inpainting pass (using ControlNet/IP-Adapter) to generate realistic light spill and contact shadows around the product without touching the product itself.
4. Short-Form Video Production: Automate the creation of 9:16 vertical clips (Reels/TikTok) using Runway Gen-3 Alpha Turbo or Creatomate. The strategy must focus on animating the background only or using subtle camera movement to maintain 100% product integrity.
5. Automated QA & Guardrails: Implement a final vision-based check (using CLIP or ViT-style APIs) to compare the final asset against the original photo, flagging any warped or distorted products for review.
6. Copywriting & Scheduling: Integrate ChatGPT API for SEO-optimized captions and hooks, then push final assets to Buffer or Later.com.
Required Technical Expertise:
• Make.com Orchestration: Expert-level ability to connect complex media pipelines via Webhooks and APIs.
• ComfyUI Mastery: Deep knowledge of node-based workflows, ControlNet (Canny/Depth), and IP-Adapters for style and geometry locking.
• Lighting Physics: Ability to engineer prompts using technical terms like “Subsurface Scattering,” “Chiaroscuro,” and “Volumetric Fog” to ensure photorealistic light behavior.
• API Integration: Experience with Photoroom, Runway, Creatomate, and OpenAI.
Aesthetic Goal: The final output must consistently reflect a “cozy, moody, cinematic” atmosphere with high-end, magazine-quality lighting.
Deliverables:
• A functional Make.com blueprint.
• A ComfyUI node graph optimized for product preservation.
• A structured Airtable or Google Sheets “Source of Truth” database