Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Generate command #6

Merged
merged 2 commits into from
Dec 6, 2023
Merged

feat: Generate command #6

merged 2 commits into from
Dec 6, 2023

Conversation

carlosgjs
Copy link
Collaborator

@carlosgjs carlosgjs commented Dec 6, 2023

This PR builds upon #5

  • Support for autodoc generate <python_file>
  • Renamed predict to eval since it'll be used for computing metrics
  • AzureML test run for generate.yml

Sample local run:

$ autodoc generate AOS/sweetPeaEnglishTranslator/validation/codeToCode/static_text/example_1/code_1.py
2023-12-05 16:43:56,498 INFO predict_hf.__init__(): Loading model from meta-llama/llama-2-7b-chat-hf
Loading checkpoint shards: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 2/2 [00:04<00:00,  2.21s/it]
2023-12-05 16:44:19,785 INFO predict_hf.__init__(): Model loaded
2023-12-05 16:44:20,162 INFO predict_hf.predict(): Generating 1 predictions
2023-12-05 16:46:05,671 INFO predict_hf.predict(): Generated 1 results
2023-12-05 16:46:05,671 INFO main.generate(): Writing output to output.txt
$ cat output.txt
Purpose:
The purpose of this experiment is to investigate the relationship between word recognition and color perception. Specifically, the experiment aims to determine whether the recognition of a word is influenced by the color of the ink in which it is written.

Procedure:
The experiment consists of a within-subjects design, in which participants are presented with a series of words written in different colors. The participants are asked to recognize the words and indicate whether they are congruent or incongruent with the color of the ink. The experiment uses a blocking procedure, in which the order of the words is randomized within each participant, and the color of the ink is constant for each word. The experiment also includes a minimum number of trials constraint to ensure that the results are reliable and accurate.

@carlosgjs carlosgjs marked this pull request as ready for review December 6, 2023 01:22
Copy link
Contributor

@younesStrittmatter younesStrittmatter left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

looks good

@carlosgjs carlosgjs merged commit d1d6d4c into carlosg/prompts Dec 6, 2023
1 check passed
@carlosgjs carlosgjs deleted the carlosg/generate branch December 6, 2023 22:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants