Instruct-NeRF2NeRF: Editing 3D Scenes with Instructions

Edit a 3D scene with text instructions

✅ 用 Nerf 来描述 3D scene。通过文件条件把原 Nerf，变成另一个 Nerf，从而得到新的 3D scene.

P47

方法

Edit a 3D scene with text instructions

• Given existing scene, use Instruct Pix2Pix to edit image at different viewpoints.
• Continue to train the NeRF and repeat the above process

✅ 首先有一个训好的 Nerf. 对一个特定的场景使用 Instruct Pix 2 pix 在 2D 上编辑训练新的 Werf.
✅ 基于 score disllation sampling.

P48

With each iteration, the edits become more consistent.