-
Notifications
You must be signed in to change notification settings - Fork 0
/
Copy pathisolation-result-238241.json
16 lines (16 loc) · 9.4 KB
/
isolation-result-238241.json
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
{
"critiques": {
"680": {
"rubric_items": {
"5510": {
"result": "failed",
"observation": "Not all of the tests passed.\n\n```\n************************************************************************\n Test Failure Feedback \n************************************************************************\n\nFailed Test: 2. Test functionality of MinimaxPlayer.minimax()\n----------------------------------------------------------------------\nTraceback (most recent call last):\n File \"/home/grader/isolation/workspace/game_agent.py\", line 278, in minimax\n key=lambda m: min_value(self,game.forecast_move(m),depth=depth-1))\n File \"/home/grader/isolation/workspace/game_agent.py\", line 278, in <lambda>\n key=lambda m: min_value(self,game.forecast_move(m),depth=depth-1))\n\n ...lines elided for space... \n\n File \"/home/grader/isolation/workspace/game_agent.py\", line 252, in min_value\n v = min(v, max_value(self,game.forecast_move(m),depth=depth-1))\n File \"/home/grader/isolation/workspace/game_agent.py\", line 271, in max_value\n v = max(v, min_value(self,game.forecast_move(m),depth=depth-1))\n File \"/home/grader/isolation/workspace/game_agent.py\", line 252, in min_value\n v = min(v, max_value(self,game.forecast_move(m),depth=depth-1))\n File \"/home/grader/isolation/workspace/game_agent.py\", line 271, in max_value\n v = max(v, min_value(self,game.forecast_move(m),depth=depth-1))\n File \"/home/grader/isolation/workspace/game_agent.py\", line 252, in min_value\n v = min(v, max_value(self,game.forecast_move(m),depth=depth-1))\n File \"/home/grader/isolation/workspace/game_agent.py\", line 271, in max_value\n v = max(v, min_value(self,game.forecast_move(m),depth=depth-1))\n File \"/home/grader/isolation/workspace/game_agent.py\", line 252, in min_value\n v = min(v, max_value(self,game.forecast_move(m),depth=depth-1))\n File \"/home/grader/isolation/workspace/game_agent.py\", line 262, in max_value\n if self.time_left() < self.TIMER_THRESHOLD:\n File \"/home/grader/isolation/testcases.py\", line 64, in timeout\n \"Otherwise you may need to work on making your code more efficient.\"\nRuntimeError: Your agent ran much longer than expected for this test case. Check your search termination conditions to ensure you are cutting off at the depth limit or when the game ends. Otherwise you may need to work on making your code more efficient.\n\n\nFailed Test: 3. Test that minimax() raises SearchTimeout when the timer expires\n----------------------------------------------------------------------\nTraceback (most recent call last):\n File \"/home/grader/isolation/workspace/game_agent.py\", line 278, in minimax\n key=lambda m: min_value(self,game.forecast_move(m),depth=depth-1))\n File \"/home/grader/isolation/workspace/game_agent.py\", line 278, in <lambda>\n key=lambda m: min_value(self,game.forecast_move(m),depth=depth-1))\n\n ...lines elided for space... \n\n File \"/home/grader/isolation/workspace/game_agent.py\", line 271, in max_value\n v = max(v, min_value(self,game.forecast_move(m),depth=depth-1))\n File \"/home/grader/isolation/workspace/game_agent.py\", line 252, in min_value\n v = min(v, max_value(self,game.forecast_move(m),depth=depth-1))\n File \"/home/grader/isolation/workspace/game_agent.py\", line 271, in max_value\n v = max(v, min_value(self,game.forecast_move(m),depth=depth-1))\n File \"/home/grader/isolation/workspace/game_agent.py\", line 252, in min_value\n v = min(v, max_value(self,game.forecast_move(m),depth=depth-1))\n File \"/home/grader/isolation/workspace/game_agent.py\", line 271, in max_value\n v = max(v, min_value(self,game.forecast_move(m),depth=depth-1))\n File \"/home/grader/isolation/workspace/game_agent.py\", line 252, in min_value\n v = min(v, max_value(self,game.forecast_move(m),depth=depth-1))\n File \"/home/grader/isolation/workspace/game_agent.py\", line 271, in max_value\n v = max(v, min_value(self,game.forecast_move(m),depth=depth-1))\n File \"/home/grader/isolation/workspace/game_agent.py\", line 242, in min_value\n if self.time_left() < self.TIMER_THRESHOLD:\n File \"/home/grader/isolation/testcases.py\", line 64, in timeout\n \"Otherwise you may need to work on making your code more efficient.\"\nRuntimeError: Your agent ran much longer than expected for this test case. Check your search termination conditions to ensure you are cutting off at the depth limit or when the game ends. Otherwise you may need to work on making your code more efficient.\n\n\nFailed Test: 5. Test interface of AlphaBetaPlayer.alphabeta()\n----------------------------------------------------------------------\nTraceback (most recent call last):\n File \"/home/grader/isolation/workspace/game_agent.py\", line 371, in alphabeta\n raise NotImplementedError\nNotImplementedError\n\n\nFailed Test: 6. Test the interface of AlphaBetaPlayer.get_move()\n----------------------------------------------------------------------\nTraceback (most recent call last):\n File \"/home/grader/isolation/workspace/game_agent.py\", line 320, in get_move\n raise NotImplementedError\nNotImplementedError\n\n\nFailed Test: 7. Test functionality of AlphaBetaPlayer.alphabeta()\n----------------------------------------------------------------------\nTraceback (most recent call last):\n File \"/home/grader/isolation/workspace/game_agent.py\", line 371, in alphabeta\n raise NotImplementedError\nNotImplementedError\n\n\nFailed Test: 8. Test that alphabeta() raises SearchTimeout when the timer expires\n----------------------------------------------------------------------\nTraceback (most recent call last):\n File \"/home/grader/isolation/workspace/game_agent.py\", line 371, in alphabeta\n raise NotImplementedError\nNotImplementedError\n\n\nFailed Test: 9. Test iterative deepening in AlphaBetaPlayer.get_move()\n----------------------------------------------------------------------\nTraceback (most recent call last):\n File \"/home/grader/isolation/workspace/game_agent.py\", line 320, in get_move\n raise NotImplementedError\nNotImplementedError\n\n\nFailed Test: 10. Test that AlphaBetaPlayer successfully plays a full game\n----------------------------------------------------------------------\nTraceback (most recent call last):\nNotImplementedError\n\nDuring handling of the above exception, another exception occurred:\n\nAssertionError: Your agent raised an error while attempting to play a complete game against another agent. Make sure that your agent can play an entire game -- including selecting initial moves on an empty board.\nException: \n\n\n************************************************************************\n Test Result Summary \n************************************************************************\n\n1. Test output interface of MinimaxPlayer.minimax(): .\n2. Test functionality of MinimaxPlayer.minimax(): E\n3. Test that minimax() raises SearchTimeout when the timer expires: E\n4. Test that MinimaxPlayer successfully plays a full game: .\n5. Test interface of AlphaBetaPlayer.alphabeta(): E\n6. Test the interface of AlphaBetaPlayer.get_move(): E\n7. Test functionality of AlphaBetaPlayer.alphabeta(): E\n8. Test that alphabeta() raises SearchTimeout when the timer expires: E\n9. Test iterative deepening in AlphaBetaPlayer.get_move(): E\n10. Test that AlphaBetaPlayer successfully plays a full game: F\n11. Test output interface of custom_score(): .\n12. Test output interface of custom_score_2(): .\n13. Test output interface of custom_score_3(): .\n\n------------------------------------------------------------------------\n . - Test Passed F - Test Failed E - Error \n\n```"
},
"7303": {
"result": "failed",
"observation": "Not all of the tests passed.\n\n```\n************************************************************************\n Test Failure Feedback \n************************************************************************\n\nFailed Test: 14. Submission includes heuristic_analysis.pdf\n----------------------------------------------------------------------\nAssertionError: False is not true : You must submit a report named heuristic_analysis.pdf for review.\n\n\nFailed Test: 15. Submission includes research_review.pdf\n----------------------------------------------------------------------\nAssertionError: False is not true : You must submit a report named research_review.pdf for review.\n\n\n************************************************************************\n Test Result Summary \n************************************************************************\n\n14. Submission includes heuristic_analysis.pdf: F\n15. Submission includes research_review.pdf: F\n\n------------------------------------------------------------------------\n . - Test Passed F - Test Failed E - Error \n\n```"
}
}
}
}
}