Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing  

Zhangchen Xu¹,  Fengqing Jiang¹,  Luyao Niu¹,  Yuntian Deng², 
Radha Poovendran¹,  Yejin Choi^1,2,  Bill Yuchen Lin², 
¹ University of Washington    ² Allen Institute for AI