When I export the excel which contains an error cell (a formula error like #NAME!), the cell's text is gone.

First, please open a book. Then, insert a formula like "=XXX(123)", the XXX is not a valid name. Now, if you export and reopen the book, you will find the "=XXX(123)" has gone.