You're wrong. The Huichol people in Mexico have been using Peyote as part of their religion for centuries.I doubt people did what you think they did thousands of years back.
Cannabis has been part of the Hindu religion and Sikh religion for centuries as well.
Native Americans made use of tobacco long before Europe discovered the "New World". Extremely high doses of tobacco can make it a hallucinogen.
Alcohol has long been part of human history.
The Coca plant, from which one can extract cocaine, has long been part of Central and South American culture. Although it wasn't until the 19th century that cocaine was extracted and used.

