Rice milk can be made with beta amalyze an enzyme derived from barley which is chametz and would make the rice milk chametz.

The following brands of OU Kosher pareve original or plain rice milk do not contain any chametz, but are kitniyot:

Clearly Organic
Harris Teeter
Full Circle
Hy-Vee
Meijer
Nature’s Place
Shop Rite