KEMBAR78
Fix Fairness optimization dialogs (What-If Tool) by grovina · Pull Request #2694 · tensorflow/tensorboard · GitHub
Skip to content

Conversation

@grovina
Copy link
Contributor

@grovina grovina commented Sep 24, 2019

  • Motivation for features / changes
    All Fairness optimization info icons were opening the first one (Custom threshold) when clicked.
    Also updated description for Equal Opportunity optimisation, which was inaccurate.

  • Technical description of changes
    Made function openDialog open the next sibling to the clicked element.
    Also checked that all paper-dialog DOMs were positioned where they should, so that this function would work for all cases -- the only two cases I moved would actually work as they were, but we'd rather have positioned in the same way as the others (they were children; we want siblings).

  • Screenshots of UI changes
    Only actual change is the Equal Opportunity description.

Screenshot 2019-09-24 at 13 54 51

  • Detailed steps to verify changes work correctly (as executed by you)
    Open each dialog and confirm it's the one supposed to open:

    • Nearest counterfactual
    • Similarity to selected datapoint
    • Partial Dependence Plots
    • Ground truth
    • Cost ratio
    • Fairness (6 of them)
    • Classification Performance Table
    • Regression Performance Table
    • Exploring Classification Performance
    • ROC curve
    • PR curve
  • Alternate designs / implementations considered
    N/A

From previous explanation was, we could understand that equal
opportunity meant equal _precision_ (`TP/(TP+FP)`), which is not the
case. The measure being equalized in Equal Opportunity is `TP/(TP+FN)`,
which is called _sensitivity_.
When tapping on an info button, the first paper-dialog DOM in the button's grandparent was opening. This caused a problem when all elements had the same grandparent, so that clicking any one of them would open the first dialog.
I've tested the other cases and they are all working fine.
@grovina
Copy link
Contributor Author

grovina commented Sep 24, 2019

For completeness: the Settings dialog is not concerned here, because it uses a separate function (settingsClicked_).

@jameswex jameswex merged commit 20c11dc into tensorflow:master Sep 24, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants