Custom system messages #5

dex3r · 2023-03-25T18:55:11Z

In FollowNextStepExecutor, allow for the default System Message to be overridden from outside.

github-actions · 2023-03-25T18:55:33Z

Hello, GPT-Codemaster here. I'm starting to work on the issue, give me a moment...

github-actions · 2023-03-25T18:55:51Z

Sending request to the AI using Chat interface

System message:

You are an AI system that does programming tasks by reading the issue specification and modifying the existing code by changing it or adding new code to resolve the user request. You minimize changes to the code and make sure not to modify anything that the user has not requested. Do not remove classes, methods, or fields - only add or modify existing ones. You will be doing the work in steps. The results of your work will be automatically put on Github. Always print the whole source, never the 'The rest of the class remains unchanged' comment

User Request:

The user request:
Custom system messages
In FollowNextStepExecutor, allow for the default System Message to be overridden from outside.

Do this in steps:

From a list of files select ones that will be needed to see or modify to program the user request. You will be shown content of those files. You have a limited memory so you will only see the selected ones.
Modify selected existing files one by one
Create needed new files one by one

Here is a hierarchical view of files in the project::

GithubIssueListener/IInputProvider.cs
GithubIssueListener/ListenerEntryPoint.cs
GithubIssueListener/SolverExceptionNotifier.cs
GithubIssueListener/ISolverExceptionNotifier.cs
GithubIssueListener/IssueSolvingStarter.cs
GithubIssueListener/InputProviderFromEnvironmentVariables.cs
GithubIssueListener/GithubIssueListener.csproj
GithubIssueListener/IssueListenerInput.cs
AiProgrammerTests/AiProgrammerTests.csproj
AiProgrammerTests/DependenciesTest.cs
AiProgrammerTests/ChatMessageRoleTests.cs
AiProgrammerTests/StringExtensionsSubstringSafeTests.cs
AiProgrammerTests/ClassExtractorTests.cs
AiProgrammer/Logging/ISolverProgressLogger.cs
AiProgrammer/Logging/SolverProgressLoggerInIssue.cs
AiProgrammer/Solving/Utils/UnexpectedAiOutputException.cs
AiProgrammer/Solving/GithubIssue/IGithubIssueSolver.cs
AiProgrammer/Solving/GithubIssue/GithubIssueSolverWithMethodSelection.cs
AiProgrammer/Solving/GithubIssue/InIssueNoChangesNotifier.cs
AiProgrammer/Solving/GithubIssue/GithubIssueSolverFileByFile.cs
AiProgrammer/Solving/GithubIssue/IIssueDescriptionProvider.cs
AiProgrammer/Solving/GithubIssue/GithubIssueContextProvider.cs
AiProgrammer/Solving/GithubIssue/IGithubIssueContextProvider.cs
AiProgrammer/Solving/GithubIssue/IssueDescriptionProvider.cs
AiProgrammer/Solving/Steps/Helpers/CurrentStepsHolder.cs
AiProgrammer/Solving/Steps/Helpers/FollowNextStepExecutor.cs
AiProgrammer/Solving/Steps/Helpers/ICurrentStepsHolder.cs
AiProgrammer/Solving/Steps/EntrySteps/StepSolveGithubIssueWithMethodSelection.cs
AiProgrammer/Solving/Steps/EntrySteps/StepSolveGithubIssueFileByFile.cs
AiProgrammer/Solving/Steps/ConcreteSteps/StepNotifyAboutPullRequest.cs
AiProgrammer/Solving/Steps/ConcreteSteps/StepModifyExistingFilesOneByOne.cs
AiProgrammer/Solving/Steps/ConcreteSteps/StepChangeFilesUsingCommands.cs
AiProgrammer/Solving/Steps/ConcreteSteps/StepCreateChangesCommands.cs
AiProgrammer/Solving/Steps/ConcreteSteps/StepCreatePullRequest.cs
AiProgrammer/Solving/Steps/ConcreteSteps/StepSelectMethodsToPreview.cs
AiProgrammer/Solving/Steps/ConcreteSteps/StepCreateNewFilesOneByOne.cs
AiProgrammer/Solving/Steps/ConcreteSteps/StepSelectFilesToPreview.cs
AiProgrammer/Solving/Steps/ISolverStep.cs
AiProgrammer/Solving/Steps/IStepsCollection.cs
AiProgrammer/Solving/Steps/ISolverStepWithSubsteps.cs
AiProgrammer/Solving/Model/FileAndMethodName.cs
AiProgrammer/Solving/Model/GithubIssueContext.cs
AiProgrammer/Solving/Commands/IModifyCodebaseCommand.cs
AiProgrammer/Github/Issues/IIssueUrlParser.cs
AiProgrammer/Github/Issues/IssueUrlParser.cs
AiProgrammer/Github/Model/IssueInfo.cs
AiProgrammer/Github/Model/RepoInfo.cs
AiProgrammer/Github/Model/RepoName.cs
AiProgrammer/Github/Model/RepoOwner.cs
AiProgrammer/Github/PullRequests/PullRequestCreator.cs
AiProgrammer/Github/GithubServices.cs
AiProgrammer/Github/GithubClientProviderForToken.cs
AiProgrammer/Github/GithubContextClientProvider.cs
AiProgrammer/Github/IGithubClientProviderForToken.cs
AiProgrammer/Github/IGithubContextClientProvider.cs
AiProgrammer/Core/CodeStatics.cs
AiProgrammer/CodeProcessing/IClassExtractor.cs
AiProgrammer/CodeProcessing/ClassExtractorCSharp.cs
AiProgrammer/Extensions/StringExtensions.cs
AiProgrammer/IO/FileContent.cs
AiProgrammer/IO/ProjectContentReader.cs
AiProgrammer/IO/IProjectContentReader.cs
AiProgrammer/IO/FilePath.cs
AiProgrammer/AiInterface/ChatCompletions.cs
AiProgrammer/AiInterface/IChat.cs
AiProgrammer/AiInterface/ICompletions.cs
AiProgrammer/AiProgrammer.csproj.DotSettings
AiProgrammer/AiProgrammerServices.cs
AiProgrammer/AiProgrammer.csproj
LICENSE
global.json
.gitignore
AiProgrammer.sln
Readme.md
AiProgrammer.sln.DotSettings

You are currently in step one (1). Please provide a list of files you think will help you the most when solving the problem. List them from most likely to help solve to problem to least likely. Print each path in new line without numerating them. Make sure to always print a full path.
�n

github-actions · 2023-03-25T18:55:54Z

AI Response

AiProgrammer/Solving/Steps/Helpers/FollowNextStepExecutor.cs

github-actions · 2023-03-25T18:55:55Z

Sending request to the AI using Chat interface

System message:

You are an AI system that does programming tasks by reading the issue specification and modifying the existing code by changing it or adding new code to resolve the user request. You minimize changes to the code and make sure not to modify anything that the user has not requested. Do not remove classes, methods, or fields - only add or modify existing ones. You will be doing the work in steps. The results of your work will be automatically put on Github. Always print the whole source, never the 'The rest of the class remains unchanged' comment

User Request:

The user request:
Custom system messages
In FollowNextStepExecutor, allow for the default System Message to be overridden from outside.

Do this in steps:

From a list of files select ones that will be needed to see or modify to program the user request. You will be shown content of those files. You have a limited memory so you will only see the selected ones.
Modify selected existing files one by one
Create needed new files one by one

You are currently in step 'Modify selected existing files one by one'

Already reviewed files with your own description of what happened:

Files left to review:

Current file path:
AiProgrammer/Solving/Steps/Helpers/FollowNextStepExecutor.cs

Current file content:

using System.Text;
using AiProgrammer.AiInterface;
using AiProgrammer.Solving.GithubIssue;

namespace AiProgrammer.Solving.Steps.Helpers;

public class FollowNextStepExecutor
{
    private readonly ICompletions _completions;
    private readonly IIssueDescriptionProvider _issueDescriptionProvider;
    private readonly ICurrentStepsHolder _currentStepsHolder;

    public FollowNextStepExecutor(ICompletions completions, IIssueDescriptionProvider issueDescriptionProvider,
        ICurrentStepsHolder currentStepsHolder)
    {
        _completions = completions;
        _issueDescriptionProvider = issueDescriptionProvider;
        _currentStepsHolder = currentStepsHolder;
    }
    
    public async Task<string> ExecuteStep(string contentDescription, string content, string currentStepDescription)
    {
        string stepContent = $"{contentDescription}:\n" +
                             $"\n" +
                             $"{content}\n" +
                             $"\n" +
                             $"---" +
                             $"\n" +
                             $"{currentStepDescription}";

        string issueDescription = await _issueDescriptionProvider.GetIssueDescription();

        string systemMessage = GetSystemMessage();
        string userMessage = GetFullUserInput(issueDescription, stepContent);

        return await _completions.GetCompletion(systemMessage, userMessage);
    }
    
    public async Task<string> ExecuteStep(string stepDescription, string prompt)
    {
        string issueDescription = await _issueDescriptionProvider.GetIssueDescription();

        string fullStepPrompt = $"You are currently in step '{stepDescription}'\n" +
                                $"\n" +
                                $"{prompt}";
        
        string systemMessage = GetSystemMessage();
        string userMessage = GetFullUserInput(issueDescription, fullStepPrompt);

        return await _completions.GetCompletion(systemMessage, userMessage);
    }
    
    private string GetFullUserInput(string issueDescription, string stepInstructions)
    {
        return $"{GetMessageTop(issueDescription)}\n" +
               $"\n" +
               $"{stepInstructions}";
    }

    private string GetSystemMessage()
    {
        return "You are an AI system that does programming tasks by reading the issue specification and modifying the existing code by " +
               "changing it or adding new code to resolve the user request. You minimize changes to the code and make sure not to modify " +
               "anything that the user has not requested. Do not remove classes, methods, or fields - only add or modify existing ones. " +
               "You will be doing the work in steps. The results of your work will be automatically put on Github. Always print " +
               "the whole source, never the 'The rest of the class remains unchanged' comment";
    }

    private string GetMessageTop(string issueDescription)
    {
        return $"The user request: \n" +
               $"{issueDescription}\n" +
               $"\n" +
               $"---\n" +
               $"\n" +
               $"{GetStepsDescription()}";
    }

    private string GetStepsDescription()
    {
        IReadOnlyList<ISolverStep> steps = _currentStepsHolder.GetCurrentSteps().Steps;

        StringBuilder stepsDescriptionBuilder = new();
        stepsDescriptionBuilder.AppendLine("Do this in steps:\n");

        int stepNumber = 1;
        
        for (int i = 0; i < steps.Count; i++)
        {
            ISolverStep step = steps[i];

            if (step.ShowInStepsListForModel == false)
            {
                continue;
            }

            stepsDescriptionBuilder.AppendLine($"{stepNumber++}. {step.DescriptionForModel}");
        }

        if (stepNumber == 1)
        {
            throw new Exception("No steps to tell the model");
        }

        return stepsDescriptionBuilder.ToString();
    }
}

Select one command with this parameters to execute:

next_file [Note to yourself of what you saw that can be useful in next steps to solve the issue
and when changing or creating next files. Make sure to include all needed information as you won't see this file again and won't remember
what was inside.] - Do not modify this file and go to the next
replace_file [(in new line) new content in code block] [short description of what was actually modified and
why, that can be useful in next steps] - Modify or remove the file by re-writing it's content. Write a short description of what was
modified, this description will be read only by you when moving to the next file

�n

github-actions · 2023-03-25T18:57:08Z

AI Response

replace_file

using System.Text;
using AiProgrammer.AiInterface;
using AiProgrammer.Solving.GithubIssue;

namespace AiProgrammer.Solving.Steps.Helpers;

public class FollowNextStepExecutor
{
    private readonly ICompletions _completions;
    private readonly IIssueDescriptionProvider _issueDescriptionProvider;
    private readonly ICurrentStepsHolder _currentStepsHolder;
    private string _customSystemMessage;

    public FollowNextStepExecutor(ICompletions completions, IIssueDescriptionProvider issueDescriptionProvider,
        ICurrentStepsHolder currentStepsHolder)
    {
        _completions = completions;
        _issueDescriptionProvider = issueDescriptionProvider;
        _currentStepsHolder = currentStepsHolder;
        _customSystemMessage = null;
    }
    
    public void SetCustomSystemMessage(string customSystemMessage)
    {
        _customSystemMessage = customSystemMessage;
    }

    public async Task<string> ExecuteStep(string contentDescription, string content, string currentStepDescription)
    {
        string stepContent = $"{contentDescription}:\n" +
                             $"\n" +
                             $"{content}\n" +
                             $"\n" +
                             $"---" +
                             $"\n" +
                             $"{currentStepDescription}";

        string issueDescription = await _issueDescriptionProvider.GetIssueDescription();

        string systemMessage = GetSystemMessage();
        string userMessage = GetFullUserInput(issueDescription, stepContent);

        return await _completions.GetCompletion(systemMessage, userMessage);
    }
    
    public async Task<string> ExecuteStep(string stepDescription, string prompt)
    {
        string issueDescription = await _issueDescriptionProvider.GetIssueDescription();

        string fullStepPrompt = $"You are currently in step '{stepDescription}'\n" +
                                $"\n" +
                                $"{prompt}";
        
        string systemMessage = GetSystemMessage();
        string userMessage = GetFullUserInput(issueDescription, fullStepPrompt);

        return await _completions.GetCompletion(systemMessage, userMessage);
    }
    
    private string GetFullUserInput(string issueDescription, string stepInstructions)
    {
        return $"{GetMessageTop(issueDescription)}\n" +
               $"\n" +
               $"{stepInstructions}";
    }

    private string GetSystemMessage()
    {
        if (_customSystemMessage != null)
        {
            return _customSystemMessage;
        }

        return "You are an AI system that does programming tasks by reading the issue specification and modifying the existing code by " +
               "changing it or adding new code to resolve the user request. You minimize changes to the code and make sure not to modify " +
               "anything that the user has not requested. Do not remove classes, methods, or fields - only add or modify existing ones. " +
               "You will be doing the work in steps. The results of your work will be automatically put on Github. Always print " +
               "the whole source, never the 'The rest of the class remains unchanged' comment";
    }

    private string GetMessageTop(string issueDescription)
    {
        return $"The user request: \n" +
               $"{issueDescription}\n" +
               $"\n" +
               $"---\n" +
               $"\n" +
               $"{GetStepsDescription()}";
    }

    private string GetStepsDescription()
    {
        IReadOnlyList<ISolverStep> steps = _currentStepsHolder.GetCurrentSteps().Steps;

        StringBuilder stepsDescriptionBuilder = new();
        stepsDescriptionBuilder.AppendLine("Do this in steps:\n");

        int stepNumber = 1;
        
        for (int i = 0; i < steps.Count; i++)
        {
            ISolverStep step = steps[i];

            if (step.ShowInStepsListForModel == false)
            {
                continue;
            }

            stepsDescriptionBuilder.AppendLine($"{stepNumber++}. {step.DescriptionForModel}");
        }

        if (stepNumber == 1)
        {
            throw new Exception("No steps to tell the model");
        }

        return stepsDescriptionBuilder.ToString();
    }
}

Added a private field _customSystemMessage and a public method SetCustomSystemMessage to allow for the default System Message to be overridden from outside.

github-actions · 2023-03-25T18:57:09Z

Sending request to the AI using Chat interface

System message:

You are an AI system that does programming tasks by reading the issue specification and modifying the existing code by changing it or adding new code to resolve the user request. You minimize changes to the code and make sure not to modify anything that the user has not requested. Do not remove classes, methods, or fields - only add or modify existing ones. You will be doing the work in steps. The results of your work will be automatically put on Github. Always print the whole source, never the 'The rest of the class remains unchanged' comment

User Request:

The user request:
Custom system messages
In FollowNextStepExecutor, allow for the default System Message to be overridden from outside.

Do this in steps:

From a list of files select ones that will be needed to see or modify to program the user request. You will be shown content of those files. You have a limited memory so you will only see the selected ones.
Modify selected existing files one by one
Create needed new files one by one

You are currently in step 'Create needed new files one by one'

Already reviewed files with your own description of what happened:
AiProgrammer/Solving/Steps/Helpers/FollowNextStepExecutor.cs - modified - Added a private field _customSystemMessage and a public method SetCustomSystemMessage to allow for the default System Message to be overridden from outside.

New files you created:

Select one command with parameters to execute:

do_not_create_more_files - Use if there is no need to create a new file and move to the next step
create_new_file [path] [(in new line)new content in code block] [short description of what was created and why] - Create new file by providing its content. Write a short description of what was created, this description will be read only by you when moving to the next step

�n

github-actions · 2023-03-25T18:57:11Z

AI Response

do_not_create_more_files

github-actions · 2023-03-25T18:57:15Z

Pull Request created: #6

dex3r added the GPT-Codemaster attention needed label Mar 25, 2023

github-actions bot removed the GPT-Codemaster attention needed label Mar 25, 2023

github-actions bot added a commit that referenced this issue Mar 25, 2023

[GPT-Codemaster] Progress on issue #5: Custom system messages

a09b9a5

github-actions bot linked a pull request Mar 25, 2023 that will close this issue

[GPT-Codemaster] Fixes issue #5: Custom system messages #6

Open

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Custom system messages #5

Custom system messages #5

dex3r commented Mar 25, 2023

github-actions bot commented Mar 25, 2023

github-actions bot commented Mar 25, 2023

github-actions bot commented Mar 25, 2023

github-actions bot commented Mar 25, 2023

github-actions bot commented Mar 25, 2023

github-actions bot commented Mar 25, 2023

github-actions bot commented Mar 25, 2023

github-actions bot commented Mar 25, 2023

Custom system messages #5

Custom system messages #5

Comments

dex3r commented Mar 25, 2023

github-actions bot commented Mar 25, 2023

github-actions bot commented Mar 25, 2023

Sending request to the AI using Chat interface

System message:

User Request:

github-actions bot commented Mar 25, 2023

AI Response

github-actions bot commented Mar 25, 2023

Sending request to the AI using Chat interface

System message:

User Request:

github-actions bot commented Mar 25, 2023

AI Response

github-actions bot commented Mar 25, 2023

Sending request to the AI using Chat interface

System message:

User Request:

github-actions bot commented Mar 25, 2023

AI Response

github-actions bot commented Mar 25, 2023