Adversarial Representation Learning with Closed-Form Solvers

Requirements

1. Require Python3
2. Require PyTorch1.0
3. Require Visdom0.1.8.9
4. Check requirements.txt for detailed dependencies.

Commands to Reproduce Results in Paper

Synthetic Gaussian Dataset

SGDA-ARL

$ python3 -m visdom.server
$ python3 main_gaussian.py --args args/Gaussian-SGDA-ARL.txt

OptNet-ARL

$ python3 -m visdom.server
$ python3 main_gaussian.py --args args/Gaussian-OptNet-ARL.txt

CelebA Dataset

SGDA-ARL

$ python3 -m visdom.server
$ python3 main_celebA.py --args args/CelebA-SGDA-ARL.txt

OptNet-ARL

$ python3 -m visdom.server
$ python3 main_celebA.py --args args/CelebA-OptNet-ARL.txt

Part A: Training the Encoder

1. Set the path to your input data and your dataset name for both training and test sets. Note: Let the data created by dataloader.py contain three items, input data, target class label and sensitive class label, respectively. Example in args/CelebA-OptNet-ARL.txt: ``` dataset_root_test = ./data/celeba/ dataset_root_train = ./data/celeba/ dataroot = ./data/celeba/

   dataset_train = CelebA_Privacy dataset_test = CelebA_Privacy

   input_filename_train = ./data/celeba/celeba-training.csv input_filename_test = ./data/celeba/celeba-evaluation.csv

2. Set the dimentionality of your embedding r and datandim, number of sensitive class label nclasses_A, and number of target class label nclasses_T. Example in args.txt:

    r = 2
   #### due to instant normalization one dimension will be lost
      
    resolution_high = 112
    resolution_wide = 96
    nclasses_A = 100
    nclasses_T = 20
   

3. Set a set trade-off parameters (0<=alpha<=1) between privacy and utility. Note: alpha=[0] is related to no privacy and alpha=[1] concerns totally to hide the sensitive attribute. ``` alpha = [0, 0.1, 0.3 ,0.5, 0.7, 0.8, 0.85, 0.9, 0.91, 0.92, 0.93, 0.94]

4. Choose your ARL method and associated networks.

   Example for OptNet-ARL:

    adverserial_type = OptNet
    loss_type_E = Projection_gauss
    sigma = 1
   
   

   Example for SGDA-ARL:

    adverserial_type = SGDA
    model_type_EA = EA
    model_type_ET = ET
   

Part B: Training the Real Adversary and Target Classifiers or Regressors

1. Visualization Settings. The parameters for visdom to plot training and testing curves.

    1) the port number for visdom -- "port"
    2) the name for current environment -- "env"
    3) if you want to create a new environment every time you run the program or
     not -- "same_env".  If you do, set it "False"; otherwise, it's "True".
   

   Example in args.txt:

    port = 8097
    env = main
    same_env = True
   

2. Select the network for target and adversary and specify their task as a regression or classification. Example in args.txt:

    model_type_A = Adversary
    model_type_T = Target
    loss_type_A = Regression
    loss_type_T = Regression
    evaluation_type_A = Top1Classification
    evaluation_type_T = Top1Classification
   

3. Finally, set the hyper parameters required to train and test the real adversary and target networks. Example in args.txt:

    nepochs = 7
    optim_method = Adam
    learning_rate_T = 3e-4
    learning_rate_A = 3e-4
    scheduler_method_A = ExponentialLR
    scheduler_options_A = {"gamma": 0.999}