Dec To Hex To Dec

mp3guy

Is it possibly while doing this conversion, that the values change? I'm doing something in VB, and when I convert like that, the numbers don't match the first ones

Hobbes

Change in what way?

You would see something like 10 Hex = 16 Dec. But the value wouldn't change to random values.

Capt'n Midnight

you could convert dec to hex , then hex to dec and see which values are different (0-9 should be the same of course) as with all programming you should at the very least test the boundry conditions..

in excel/openoffice functions are =dec2hex(a1) and =hex2dec(b2) if you need test values.

don't forget that -1 wraps around

mp3guy

could it be a character number problem? Because I'm allocating 6 character spaces for each hex value, and the hex values only go up to 16777216

Stugots

mp3guy wrote:

could it be a character number problem? Because I'm allocating 6 character spaces for each hex value, and the hex values only go up to 16777216

Possibly - 16777216 requires 7 characters in hex - 1000000

Can you give an example (where you suspect an error) of what decimal value you are starting with adn what hex value it translates to?

mp3guy

it's ok, it got around the problem

Hobbes

mp3guy wrote:

it's ok, it got around the problem

It is common courtesy to post your solution just in case someone else has the same problem later.

mp3guy

oh sorry, i found out that the numbers did match, it was just a value length problem

bobsyouruncle

hey mp3guy wat u doin

mp3guy

bobsyouruncle wrote:

hey mp3guy wat u doin

this isn't how you use a forum. When you reply to a topic, you have to say something in relation to the title/first post. If you want to talk to a single person, PM them.