However, when the file path for python assertions is specified, it is relative to where the promptfoo eval is used. This behavior breaks the tests if the evaluation is not always run from a specific ...

There are exes e.g. mapproxy-util.exe pip installs to Scripts which have the original full path to python.exe hardcoded in the exe binary. This allows them to only work from that path and prevent ...

I avoid hardcoding paths and prefer relative paths. I use os.path.join() ... When dealing with file input/output (I/O) operations in Python, always remember to open files using the correct mode.