Excellent article, in practice and literature integer differentiation(price return) is used more frequently than time differencing for financial asset price/index prediction tasks. Differencing is used more in econometrics in ARMA and ARIMA models but you highlight a very big pitfall for applying RNN/LSTM to financial time series data that people tend to ignore.