[Solved] Is there a really efficient (FAST) way to read large text files in python?

Question

No, there is no faster way of processing a file line by line, not from Python.

Your bottleneck is your hardware, not how you read the file. Python is already doing everything it can (using a buffer to read the file in larger chunks before splitting into newlines).

I suggest upgrading your disk to an SSD.

Accepted Answer

No, there is no faster way of processing a file line by line, not from Python.

Your bottleneck is your hardware, not how you read the file. Python is already doing everything it can (using a buffer to read the file in larger chunks before splitting into newlines).

I suggest upgrading your disk to an SSD.