IT appears that the chances of getting an error when using “llm-maths” is quite high.

I tried serveral Grade 12 maths questions and got quite a few errors (different types of errors).

Examples:
" An examination consists of three parts. In part A, a student must answer 2 of 3 questions. In part B, a student must answer 6 of 8 questions and in part C, a student must answer all questions. How many choices of questions does the student have?"
" The triangle bounded by the lines y = 0, y = 2x and y = -0.5x + k, with k positive, is equal to 80 square units. Find k."

LangChain attempts to find mathematical expressions that it can evaluate, so it probably is more reliable on computation than vanilla ChatGPT. But clearly still challenged with complex ‘word’ problems like your examples.