'NoneType' object is not iterable

[88arvin]

Earlier, everything was OK and I could extract tables from PDFs, whether they were on one page or spread across numerous pages using the following code.
 
However, after updation some error (TypeError: 'NoneType' object is not iterable) is now appearing only in PDFs that have a table on the first page.

with pdfplumber.open(pdf_file) as pdf:
      lst = [p.extract_table() for p in pdf.pages]
flat_list = [item for sublist in lst for item in sublist]
df = pd.DataFrame(flat_list)

Does anyone know how to resolve this error?

[jsvine]

Hi @88arvin, I believe (without being able to see the actual PDF) that you're likely getting this error because of this line:

flat_list = [item for sublist in lst for item in sublist]

That line expects every sublist to be a Python list or other iterable; but sublist will actually be None when a page does not contain a table. There are a few ways you can fix this — here's one:

non_nones = [sublist for sublist in lst if sublist is not None]
flat_list = [item for sublist in non_nones for item in sublist]

... which should filter out those Nones.

[88arvin]

But earlier it was working fine. Anyways I appreciate your response however I did something like this:

with pdfplumber.open(pdf_file) as pdf:
        try:
            lst = [p.extract_table() for p in pdf.pages]
            flat_list = [item for sublist in lst for item in sublist]
        except:
            flat_list = pdf.pages[0].extract_table()

[jsvine]

What version of pdfplumber were you using before?