Decompiler Readability Study

Decompiler Readability Study

Thank you for your interest in our study!

We are evaluating how well different decompilers help reverse engineers understand stripped binaries. You will read decompiled C code for a few functions and answer questions about what each function does, then rate the code you read.

  • The study takes about 30 minutes and should be completed in one sitting.
  • Each task shows one decompiled function next to its questions. Time spent on each task is recorded.
  • Participants who complete the study with valid responses receive an Amazon gift card by email.

Consent

Decompiler Readability Study — Information and Consent

You are invited to take part in a research study conducted by Yibo Liu and the research team at Arizona State University (ASU). Please read the information below before deciding whether to participate.

Purpose. We are studying how the output of different decompilers affects how well reverse engineers understand compiled programs. The results will help improve tools for software security analysis.

What you will do. If you agree to participate, you will:

  • answer a few questions about your background and experience;
  • complete four short tasks. In each task you read a function decompiled from a binary program and answer questions about what it does;
  • rate the readability of two decompiled versions of each function.

The study takes about 30 minutes and should be completed in one sitting.

Eligibility. You must be 18 years of age or older.

Voluntary participation. Your participation is voluntary. You may stop at any time by closing the page, without penalty. If you do not know the answer to a question, you may choose or write "I don't know".

Compensation. Participants who complete the study with valid responses will receive an Amazon gift card, sent to the email address you provide after the study ends. Because payments must first be approved by ASU's financial office, this may take some time. Responses that show the instructions were not followed (for example, copying the code into an LLM or another tool, or answering without reading the code) may not be eligible for compensation.

Risks and benefits. There are no foreseeable risks or discomforts beyond those of everyday computer use. There is no direct benefit to you; your participation will help improve tools for analyzing software.

What we collect and how we protect it. We record your answers, the time you spend on each page, whether you leave the study page while a task is open, attempts to copy or paste, and your IP address and browser type. Your email address is used only to send your compensation and to make sure each person participates only once; it will not be shared or published. Your data are stored on a secured server that only the research team can access. The results of this study may be used in reports, presentations, or publications, but only in aggregate or without information that identifies you.

Questions. If you have any questions about this study, please contact Yibo Liu at yiboliu@asu.edu. If you have questions about your rights as a participant, or if you feel you have been placed at risk, you can contact the Chair of the Human Subjects Institutional Review Board, through the ASU Office of Research Integrity and Assurance, at (480) 965-6788.

By checking the box below and continuing, you agree to participate in this study.