Right after publishing the first version of this package, I finally found out about the TC39 Temporal Proposal, which includes a PlainDate class that solves the same problem and will at some point make TimelessDate obsolete.
You can find polyfills here.