Powered by OpenAIRE graph
Found an issue? Give us feedback
addClaim

Artifact for the PETS 2026 paper: "WebSP-Eval: Evaluating Web Agents on Website Security and Privacy Tasks"

Authors: Viswanathan Ramesh, Guruprasad; Nayak, Asmit; Siddique, Basieem; Fawaz, Kassem;

Artifact for the PETS 2026 paper: "WebSP-Eval: Evaluating Web Agents on Website Security and Privacy Tasks"

Abstract

Artifact for the PETS 2026 paper "WebSP-Eval: Evaluating Web Agents on Website Security and Privacy Tasks" (Guruprasad Viswanathan Ramesh, Asmit Nayak, Basieem Siddique, and Kassem Fawaz; University of Wisconsin–Madison). WebSP-Eval measures how well LLM-powered web agents perform website security and privacy tasks (managing cookies, configuring privacy settings, revoking sessions, controlling newsletter/marketing preferences, etc.) on live websites tied to user accounts. Contents: - dataset/ — 200 task instances (138 unique tasks across 28 websites; WithNav and W/oNav prompt variants), ground-truth action sequences and UI-element annotations, and PII-templatized initial-state (S0) traces. - src/ — the web agent (adapted from WebVoyager) and the Selenium record-and-replay state-reset engine. - extension/ — Chrome MV3 record-and-replay extension for login/state traces. - judge/ — automated MLLM-as-a-judge. - docs/ — installation, account-setup, and recording guides; ARTIFACT-APPENDIX.md documents the evaluated functional test. This archive is a byte-identical snapshot of commit 83026e5a30bcacbacefd600953f9acb9b6c5a21c of https://github.com/wi-pi/webspeval_code — the version that passed PETS 2026 artifact evaluation with the Available and Functional badges. No accounts, credentials, or PII are included: the shipped state traces are templatized with {{WEBSP_ACCOUNT_*}} placeholders, and users create their own sock-puppet accounts and login traces (see docs/ACCOUNT_SETUP.md). Licensing: the code (src/, extension/, judge/, tools/) is released under the Apache License 2.0 (LICENSE-code); the dataset (dataset/) is released under CC BY-NC 4.0 (LICENSE-dataset). Project website: https://wiscprivacy.com/webspeval

Related Organizations
  • BIP!
    Impact byBIP!
    selected citations
    These citations are derived from selected sources.
    This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
    0
    popularity
    This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network.
    Average
    influence
    This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
    Average
    impulse
    This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network.
    Average
Powered by OpenAIRE graph
Found an issue? Give us feedback
selected citations
These citations are derived from selected sources.
This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
BIP!Citations provided by BIP!
popularity
This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network.
BIP!Popularity provided by BIP!
influence
This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically).
BIP!Influence provided by BIP!
impulse
This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network.
BIP!Impulse provided by BIP!
0
Average
Average
Average