I just download new version 4.10,
well before I am using version 3.something.
Kindly help me how to upgrade.
Whether should i upload all files into same directory
and then need to run upgrade3to4.php?

There's a file called upgrade.txt in there. It gives you instructions. It's a very simple process.