banner
andrewji8

Being towards death

Heed not to the tree-rustling and leaf-lashing rain, Why not stroll along, whistle and sing under its rein. Lighter and better suited than horses are straw sandals and a bamboo staff, Who's afraid? A palm-leaf plaited cape provides enough to misty weather in life sustain. A thorny spring breeze sobers up the spirit, I feel a slight chill, The setting sun over the mountain offers greetings still. Looking back over the bleak passage survived, The return in time Shall not be affected by windswept rain or shine.
telegram
twitter
github
HomeArchives

InstantID has recently become popular. The code and model have been updated, allowing for online experience or offline deployment.

#AI484
AI Translation
This post is translated from Chinese into English through AI.View Original
AI-generated summary
InstantID is a tool that can generate customized avatar photos using a reference image without the need for training any models. It combines ControlNet and IP-Adapter to control facial features during the diffusion process. One unique design of InstantID is that it uses facial embeddings from IP-Adapter as cross-attention inputs for ControlNet's UNet. It can be deployed using WebUI, ComfyUI, or by building Gradio with Python scripts.

InstantID can generate customized avatar photos with just one reference image, without the need to train any models.
Instant ID controls facial features during the diffusion process by combining ControlNet and IP-Adapter. A unique design of Instant ID is that it passes the facial embedding from IP-Adapter as cross-attention input to ControlNet's UNet.

Online experience: https://huggingface.co/spaces/InstantX/InstantID

I tried the online demo and the model has 8 preset styles.
Test 1:
Upload a still of Baobao (Hu Ge) from "Blooming Flowers" and enter the prompt below, choose the Jungle style.

image

Test 2:
Keep the facial image unchanged, upload the reference pose (shown below), enter the prompt, and choose the watercolor style.

image

Common deployments
Next, we will introduce several commonly used deployment methods:
WebUI

image

Tutorial: https://github.com/Mikubill/sd-webui-controlnet/discussions/2589

Notes:
InstantID uses 2 models on WebUI. Always set the IP-Adapter model as the first model because the ControlNet model retrieves output from the IP-Adapter model.
The models should be placed in the specified directory: {A1111_root}/models/ControlNet
Rename the models separately to ensure extension functionality recognition: ip-adapter_instant_id_sdxl and control_instant_id_sdxl.

ComfyUI

image

Tutorial: https://github.com/ZHO-ZHO-ZHO/ComfyUI-InstantID

Build with Gradio yourself
For those who are proficient in coding, you can also implement it using Python scripts without using WebUI or ComfyUI. The official repository provides examples:
https://github.com/InstantID/InstantID?tab=readme-ov-file#download

Loading...
Ownership of this post data is guaranteed by blockchain and smart contracts to the creator alone.