Hadas Orgad

I am currently pursuing my Ph.D. in the field of Natural Language Processing at the Technion-Israel Institute of Technology under the supervision of Yonatan Belinkov.

My research focus is on interpretability of large language models, exploring how they encode linguistic and factual information about the world. My primary focus lies in leveraging interpretability as a strategic tool for enhancing model performance, specifically addressing robustness and safety concerns, with the ultimate goal of improving transparency and trustworthiness. Thus, my work revolves around developing new methods for evaluating, understanding and improving the robustness of NLP models, ultimately aiming to create models that are both powerful and responsible.

I've been selected as a 2023 Apple Scholar in AI/ML.

Feel free to reach out if you're interested in brainstorming or exploring potential collaboration opportunities with me.

Past

I recently interned at Apple. Before that, I worked at Microsoft for 3.5 years (software engineering and later research).

I completed my bachelors and my masters in the Technion. During masters, I was selected for the 2022 EMEA Generation Google Scholarship. Previously, I worked in Microsoft, for the cloud security research, where I worked on data-science problems and on the application of NLP for security products.

email icon orgadhadas at gmail dot com

Publications

Diffusion Lens: Interpreting Text Encoders in Text-to-Image Pipelines

Michael Toker, Hadas Orgad, Mor Ventura, Dana Arad, Yonatan Belinkov

ACL 2024

We introduce the Diffusion Lens method to analyze text encoders intermediate representations in text-to-image models. Using the method, we perform an extensive analysis of two recent T2I models, and gain insights on both conceptual combination abilities and knowledge retrieval in the models.

Project Page Arxiv Cite
2024

ReFACT: Updating Text-to-Image Models by Editing the Text Encoder

Dana Arad*, Hadas Orgad*, Yonatan Belinkov

NAACL 2024

Text-to-image models are trained on extensive amounts of data, leading them to implicitly encode factual knowledge within their parameters. While some facts are useful, others may be incorrect or become outdated (e.g., the current President of the United States). We introduce ReFACT, a method for updating text-to-image models. ReFACT updates the weights of a specific layer in the text encoder, only modifying a tiny portion of the model's parameters, and leaving the rest of the model unaffected.

Project Page Arxiv Cite
2023

Unified Concept Editing in Diffusion Models

Rohit Gandikota, Hadas Orgad, Yonatan Belinkov, Joanna Materzyńska, David Bau

IEEE/CVF WACV 2024

Text-to-image models suffer from various safety issues that may limit their suitability for deployment. Previous methods have separately addressed individual issues of bias, copyright, and offensive content in text-to-image models. However, in the real world, all of these issues appear simultaneously in the same model. In this paper, we present a method that tackles those diverse issues with a single approach.

Project Page Arxiv Cite
2023

Editing Implicit Assumptions in Text-to-Image Diffusion Models

Hadas Orgad*, Bahjat Kawar*, Yonatan Belinkov

ICCV 2023

Text-to-image diffusion models often make implicit assumptions about the world when generating images. While some assumptions are useful (e.g., the sky is blue), they can also be outdated, incorrect, or reflective of social biases present in the training data. In this work, we aim to edit a given implicit assumption in a pre-trained diffusion model. Our method is highly efficient, as it modifies a mere 2.2% of the model's parameters in under one second.

Project Page Arxiv Cite
2023

Debiasing NLP Models Without Demographic Information

Hadas Orgad, Yonatan Belinkov

ACL 2023

In this work, we propose a debiasing method that operates without any prior knowledge of the demographics in the dataset, detecting biased examples based on an auxiliary model that predicts the main model's success and down-weights them during the training process. Results on racial and gender bias demonstrate that it is possible to mitigate social biases without having to use a costly demographic annotation process.

Arxiv Cite
2022

Choose your lenses: Flaws in gender bias evaluation

Hadas Orgad, Yonatan Belinkov

GeBNLP 2022

Considerable efforts to measure and mitigate gender bias in recent years have led to the introduction of an abundance of tasks, datasets, and metrics used in this vein. In this position paper, we assess the current paradigm of gender bias evaluation and identify several flaws in it.

Arxiv Cite
2022

How Gender Debiasing Affects Internal Model Representations, and Why It Matters

Hadas Orgad, Seraphina Goldfarb-Tarrant, Yonatan Belinkov

NAACL 2022

Common studies of gender bias in NLP focus either on extrinsic bias measured by model performance on a downstream task or on intrinsic bias found in models’ internal representations. However, the relationship between extrinsic and intrinsic bias is relatively unknown. In this work, we illuminate this relationship by measuring both quantities together.

Arxiv Cite
2022