PROMPT PROGRAMMING FOR THE VISUAL DOMAIN

Alayt Issak; Lav R. Varshney

PROMPT PROGRAMMING FOR THE VISUAL DOMAIN

Alayt Issak
, Lav R. Varshney

AI Institute

Northeastern University

Research output: Contribution to conference › Paper › peer-review

2 Scopus citations

Abstract

In this work, we ask how text-to-image synthesis via large language models can effectively probe imagery that embodies fidelity and imagination. We investigate this question in the context of prompts (writing to language models) in a novel probing mechanism known as prompt programming, or programming in natural language. We start by refining existing techniques to characterize the effect of templates on visual fidelity then hone in on approaches to capture holistic nuances within the visual domain. We present a systematic analysis of prompt engineering for visual image generation.

Original language	English
State	Published - 2023
Event	1st Tiny Papers at 11th International Conference on Learning Representations, Tiny Papers @ ICLR 2023 - Kigali, Rwanda Duration: May 5 2023 → May 5 2023

Conference

Conference	1st Tiny Papers at 11th International Conference on Learning Representations, Tiny Papers @ ICLR 2023
Country/Territory	Rwanda
City	Kigali
Period	05/5/23 → 05/5/23

Cite this

@conference{3ed8a7673f614546b510ef1f86414dcb,

title = "PROMPT PROGRAMMING FOR THE VISUAL DOMAIN",

abstract = "In this work, we ask how text-to-image synthesis via large language models can effectively probe imagery that embodies fidelity and imagination. We investigate this question in the context of prompts (writing to language models) in a novel probing mechanism known as prompt programming, or programming in natural language. We start by refining existing techniques to characterize the effect of templates on visual fidelity then hone in on approaches to capture holistic nuances within the visual domain. We present a systematic analysis of prompt engineering for visual image generation.",

author = "Alayt Issak and Varshney, \{Lav R.\}",

note = "Publisher Copyright: {\textcopyright} 2023 1st Tiny Papers Track at ICLR 2023 - Tiny Papers @ ICLR 2023. All rights reserved.; 1st Tiny Papers at 11th International Conference on Learning Representations, Tiny Papers @ ICLR 2023 ; Conference date: 05-05-2023 Through 05-05-2023",

year = "2023",

language = "English",

}

TY - CONF

T1 - PROMPT PROGRAMMING FOR THE VISUAL DOMAIN

AU - Issak, Alayt

AU - Varshney, Lav R.

PY - 2023

Y1 - 2023

N2 - In this work, we ask how text-to-image synthesis via large language models can effectively probe imagery that embodies fidelity and imagination. We investigate this question in the context of prompts (writing to language models) in a novel probing mechanism known as prompt programming, or programming in natural language. We start by refining existing techniques to characterize the effect of templates on visual fidelity then hone in on approaches to capture holistic nuances within the visual domain. We present a systematic analysis of prompt engineering for visual image generation.

AB - In this work, we ask how text-to-image synthesis via large language models can effectively probe imagery that embodies fidelity and imagination. We investigate this question in the context of prompts (writing to language models) in a novel probing mechanism known as prompt programming, or programming in natural language. We start by refining existing techniques to characterize the effect of templates on visual fidelity then hone in on approaches to capture holistic nuances within the visual domain. We present a systematic analysis of prompt engineering for visual image generation.

UR - https://www.scopus.com/pages/publications/105026745747

M3 - Paper

AN - SCOPUS:105026745747

T2 - 1st Tiny Papers at 11th International Conference on Learning Representations, Tiny Papers @ ICLR 2023

Y2 - 5 May 2023 through 5 May 2023

ER -

PROMPT PROGRAMMING FOR THE VISUAL DOMAIN

Abstract

Conference

Other files and links

Fingerprint

Cite this