Module 3- Assignment 1 Issue

Colin_Alexander · November 11, 2024, 3:33am

This lab is a total waste of time!

Colin_Alexander · November 11, 2024, 3:56am

When submitting this assignment, it shows that it failed the test case using n=13 and seed=8. It got 19 for the result but it “expected” 21. The value of 19, however, is clearly correct as can be seen by running the function with those parameter values in python 2.7.

So I asked ChatGPT:

I believe there is an error with unittest.py. Can you find it? Here is the file: [unittest.py code]

There is an issue in unittests.py with the way the test_case instance t is handled in test_magic_summation_solution. Specifically, t is created multiple times, but only the last instance is added to the cases list, which is why no case is being collected properly for feedback. Here’s how to fix it:

Append Each Test Case (t) to the List: Each instance of t should be appended to cases when created, regardless of whether it passes or fails. Currently, t is created and returned without being appended consistently.
Return the cases List in g(): After appending each t instance to cases, g() should return the entire list of test cases.

def test_magic_summation_solution(learner_func):
    def g():
        function_name = "magic_summation"
        cases = []

        # Check if the function type is correct
        if not isinstance(learner_func, FunctionType):
            t = test_case()
            t.failed = True
            t.msg = f"{function_name} has incorrect type"
            t.want = FunctionType
            t.got = type(learner_func)
            cases.append(t)  # Append the case to the list
            return cases
        
        n, seed, expected = 30, 10, 46
        try:
            result = learner_func(n, seed=seed)
            t = test_case()
        except Exception as e:
            t = test_case()
            t.failed = True
            t.msg = f"{function_name} thrown an exception. Review your syntax and make sure it is properly converted to Python 3"
            t.want = f"{function_name} must run without exceptions"
            t.got = f"Exception raised:\n\t{e}"
            cases.append(t)  # Append the case to the list
            return cases
        
        # Check if the result is as expected
        if result != expected:
            t = test_case()
            t.failed = True
            if isinstance(result, float):
                t.msg = f"{function_name} executed properly, but output is incorrect for parameters n = {n} and seed = {seed}. Note that the behavior of the division operator changed from Python 2 to Python 3. You should ask an LLM about it."
            else:
                t.msg = f"{function_name} executed properly, but output is incorrect for parameters n = {n} and seed = {seed}"
            t.want = f"{expected}"
            t.got = f"{result}"
            cases.append(t)  # Append the case to the list
            return cases
        
        # Append the passing test case if all checks pass
        cases.append(t)
        return cases
    
    cases = g()
    print_feedback(cases)

Note that I deleted the unitests.py file and updated the lab, but it still shows the old version of Oct. 9.

This is very disappointing!

Colin_Alexander · November 11, 2024, 4:58am

This exercise has been a HUGE disappointment. The issue is that the original magic_summation_python27.py function in the assignment_part_1/ folder is flawed. It must be deleted (e.g. rm assignment_part_1/magic_summation_python27.py) and then restored per the instructions. The original file gives incorrect results and will lead to issues if one uses this as the base for converting to Python 3.

I just opened this workbook today and the issue was identified a month ago. We should not have to manually do this step ourselves, as the environment should be fixed. Very disappointing.

TMosh · November 11, 2024, 5:50pm

@Colin_Alexander. Thanks for your report. It’s been forwarded to the course staff.

lucas.coutinho · November 11, 2024, 9:24pm

Hello @Colin_Alexander,

I’m really sorry to hear that you’ve encountered difficulties with this part of the assignment. It seems there might have been a mix-up. We updated the assignment about a month ago to address some issues related to differences in randomness between Python 2 and Python 3. Normally, you should have received this updated version in your workspace.

It appears you might have accessed an older version of the assignment instead. Could you please share your lab ID with me? You can find this ID in the same panel where you go to obtain a new copy of the assignment. I will investigate this to understand what went wrong and ensure it doesn’t happen again.

Thank you for bringing this to our attention,

Lucas

Colin_Alexander · November 12, 2024, 12:52am

Lab ID removed due to sensitive data

lucas.coutinho · November 12, 2024, 12:33pm

Thanks @Colin_Alexander, I’ll have a look.

Mati_chm · November 13, 2024, 7:50am

I miself have same issue.
few days working on this, but failed, after failed.
if there is tricky then should be mentioned or instruct.
i dont see how to resolve this.
i have very negative prespective about this assigment that impact about the course.
since this assigment is like wall of concrete.
sorry

Mati_chm · November 13, 2024, 7:56am

I try to use chatgpt 4O, 4o1 mini, 4o1 preview, claude, Gemini.
requesting act as software engineer expert in version transition, act assoftware engineerinf, act as qc,… only chef i dont act to

lucas.coutinho · November 13, 2024, 3:04pm

Hi @Mati_chm,

I’m sorry you are having such a hard time with this assignment.

Can you please describe the error you are facing?

Please note that changing the way how the repeated indices are removed may cause failure as np.choice of set() have both intrinsic randomness to it.

Mati_chm · November 13, 2024, 7:24pm

i copy the last onces
-1 the number don’t match -
-2 error that will be resolve in 24 hours

Mati_chm · November 13, 2024, 7:28pm

From some reason, the commentes were removed.

Failed test case: magic_summation executed properly, but output is incorrect for parameters n = 13 and seed = 20.
Expected:
17,
but got:
91.

Grader Error: Grader feedback not found