Searched refs:PRECISION (Results 1 – 5 of 5) sorted by relevance
292 |--NOTE THAT B4 THROUGH B8 ARE STORED IN DOUBLE PRECISION294 |--AND IS THEREFORE STORED AS SINGLE PRECISION.
91 static const int PRECISION = 1000; in variax_get_param_float() local118 (part_frac / ((1UL << 31) / (PRECISION / 2 * 10)) + 5) / 10; in variax_get_param_float()
797 * PRECISION INSIGHT AND/OR ITS SUPPLIERS BE LIABLE FOR ANY CLAIM, DAMAGES OR
5133 #--NOTE THAT B4 THROUGH B8 ARE STORED IN DOUBLE PRECISION5135 #--AND IS THEREFORE STORED AS SINGLE PRECISION.
5186 #--NOTE THAT A3 THROUGH A7 ARE STORED IN DOUBLE PRECISION