If you had to make a sword in prehistoric times....

If you had to make a sword in prehistoric times, you'd need to find iron ore, clay to build a tube, and charcoal. Then you could extract the iron in this way:

Prehistoric Iron Smelting Demonstration