Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[metalearn] implement raw metafeature encoder #10

Open
cosmicBboy opened this issue Jul 9, 2019 · 0 comments
Open

[metalearn] implement raw metafeature encoder #10

cosmicBboy opened this issue Jul 9, 2019 · 0 comments

Comments

@cosmicBboy
Copy link
Owner

cosmicBboy commented Jul 9, 2019

An extension to the encoder that generalizes the metadata feature
representation from hand-crafted features (e.g. mean of means of numerical
features) and instead formulate encoder as a ANN function approximator module, where the input is some raw, numericalized form of the data, and the output is some lower-dimensional encoding of the data.

Possible architectures for the differentiable module:

Transformer

  1. A hierarchical transformer that encodes each feature vector as "feature embeddings" and and each row vector as "instance embeddings".
  2. feature embeddings are computed on random samples of the feature set {f_0, f_1, ... f_n}
  3. instance embeddings are computed on random samples of the dataset (X, y)
  4. the embeddings are concatenated and passed through a fully-connected layer that has the same output dimensionality as the controller input dimensionality.
  5. this metafeature embedding is then used as input to the controller (decoder) to produce a ML framework.

CNN

A convnet can probably by used from the using the same data setup as the Transformer.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant