Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Aggregate Reporting in Worklets #164

Closed
jeffkaufman opened this issue Apr 7, 2021 · 2 comments
Closed

Aggregate Reporting in Worklets #164

jeffkaufman opened this issue Apr 7, 2021 · 2 comments

Comments

@jeffkaufman
Copy link
Contributor

As currently specified in FLEDGE, generate_bid and score_ad are pure functions. This poses challenges for debugging and experimentation: how do you know whether your code is operating correctly on user devices? (ex: #146) Event-level reporting would not be compatible with the privacy model, but what about aggregate reporting?

If the worklets had the ability to invoke the aggregate reporting API they could transmit this information privately. For example a seller might want, for their own debugging, to know why they rejected an ad, and could send ad123 rejected for reason X. If that was a sufficiently common occurrence the seller could learn about it. The seller might also want to send more-aggregated information like two separate messages, ad123 rejected and rejected for reason X, to collect information in cases where the combination of the ad ID and the rejection reason might be insufficiently common. Alternatively, a seller might want to send additional information from the auction that they wouldn't have access to in report_result because of joining concerns.

Similarly, a buyer or seller could run an experiment, perhaps to test a change in their logic or verify that a release didn't introduce regressions. They could divert when serving their logic (as in #149) or randomly during the auction, and then use aggregate reports to evaluate the effect of the change.

We believe this covers the use cases of report_loss, while also providing additional options for debugging and experimentation.

@jeffkaufman
Copy link
Contributor Author

@sbelov just pointed me to #93 which is closely related

@JensenPaul
Copy link
Collaborator

Private Aggregation API is accessible from Protected Audience bidding, scoring and reporting scripts. I'm closing this issue as I think the concern was addressed. Feel free to reopen or file another if you have further concerns.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants