OO.o 2.0 help says

"Enter the number as text. The easiest way is to enter the number starting with
an apostrophe (for example, '0987). The apostrophe will not appear in the cell,
and the number will be formatted as text. Because it is in text format, however,
you cannot calculate with this number." in 'Entering a Number with Leading
Zeros' section.

Unfortunately, this method does not work when single quotes replacement option
is turned on in AutoCorrect. The option can not be simply turned off because it
is nceessary for writing text document ( The option is shared for all components
of OO.o - see Issue 27269 ).

I believe that the possible solution is to execute 'number as text' logic before
applying AutoCorrect for single quote replacement.

How to reproduce,

1. Open Calc.
2. Select Tools > AutoCorrect > Custom Quotes.
3. Make sure that Single Quote Replace option is checked.
4. Click OK to closee the dialog.
5. Select a cell and input '0123.
6. Confirm that the cell shows '0123.

7. Select Tools > AutoCorrect > Custom Quotes.
8. Turn off Single Quote Replace option.
9. Click OK to closee the dialog.
10. Select a cell and input '0123.
11. Confirm that the cell shows 0123.