June 8, 201114 yr I see couple good arguments at present, against RAIDing SSDs for FS.First and foremost is that the TRIM command--needed to communicate empty block info from the OS file system to the SSD firmware--doesn't work with RAID configurations. I don't know of any at this point that can pass TRIM commands from the OS through the RAID controller to the drives. That's a huge negative.Second, RAID is most useful for increased throughput, because it spreads the data in parallel across several I/O channels. FS doesn't generally make use of that very well, as its file activity is predominantly large numbers of smallish files. What FS needs to shine is low random access time, and RAID configs are actually a bit slower in their random access numbers than single drives because of the interdevice syncing that has to occur to move data across the bus. It should also be noted that many of the high-capacity SSDs are (internally) RAID-like configs being controlled by a common controller chip...they are typically better performers in the access department than independent PCIe devices RAIDed together. They are also TRIM-capable.The one notable exception is those using humongous photoreal scenery databases--the increased throughput of a RAID array can be helpful moving massive photoscenery files.Yes, you're quite right, forgot about the TRIM command not running on RAID arrays.And for the reasons you state I also believe individual SSDs as opposed to RAID Arrays are the way to go for FSX.Cheers,- jahman.
June 9, 201114 yr I see couple good arguments at present, against RAIDing SSDs for FS.Second, RAID is most useful for increased throughput, because it spreads the data in parallel across several I/O channels. FS doesn't generally make use of that very well, as its file activity is predominantly large numbers of smallish files. What FS needs to shine is low random access time, and RAID configs are actually a bit slower in their random access numbers than single drives because of the interdevice syncing that has to occur to move data across the bus. It should also be noted that many of the high-capacity SSDs are (internally) RAID-like configs being controlled by a common controller chip...they are typically better performers in the access department than independent PCIe devices RAIDed together. They are also TRIM-capable.The one notable exception is those using humongous photoreal scenery databases--the increased throughput of a RAID array can be helpful moving massive photoscenery files.Hi Bob, am I correct in calculating file size by taking the properties of my FSX scenery file at 17.4GB and dividing by number of files 42,328 = .421 of a megabyte approximate? Reason I ask is that I was told that FSX uses large random file reads and I am trying to clarify reasoning behind my use of a controller card set at a 512K-stripe and 64k-cluster. Regards,Gary Andersen HAF932 Advanced, ASUS Z690-P D4, i5-12600k @4.9,NH-C14S, 2x8GB DDR4 3600, RM850x PSU,Sata DVD, Samsung 860 EVO 1TB storage, W10-Pro on Intel 750 AIC 800GB PCI-Express,MSI RTX3070 LHR 8GB, AW2720HF, VS238, Card Reader, SMT750 UPS.
June 9, 201114 yr Hi Bob, am I correct in calculating file size by taking the properties of my FSX scenery file at 17.4GB and dividing by number of files 42,328 = .421 of a megabyte approximate? Reason I ask is that I was told that FSX uses large random file reads and I am trying to clarify reasoning behind my use of a controller card set at a 512K-stripe and 64k-cluster.Average file size calculated in such a method is not representative of actual file size, and as such has no bearing on expected performance. You would actually need to look at individual file sizes to determine the best stripe and cluster sizes.
June 10, 201114 yr Average file size calculated in such a method is not representative of actual file size, and as such has no bearing on expected performance. You would actually need to look at individual file sizes to determine the best stripe and cluster sizes.That being the case,it would make it a whole-bunch of small files as the Colonel, stated.Thank you. Regards,Gary Andersen HAF932 Advanced, ASUS Z690-P D4, i5-12600k @4.9,NH-C14S, 2x8GB DDR4 3600, RM850x PSU,Sata DVD, Samsung 860 EVO 1TB storage, W10-Pro on Intel 750 AIC 800GB PCI-Express,MSI RTX3070 LHR 8GB, AW2720HF, VS238, Card Reader, SMT750 UPS.
June 10, 201114 yr That being the case,it would make it a whole-bunch of small files as the Colonel, stated.Thank you.A few years ago I ran filemon during an FSX session and then did a histogram of the sizes of the files in the log that FSX was accessing. For the life of me I can't find the data from that experiment (I think it may have gone to data heaven on a drive that crashed last year), but the conclusion I drew was that FSX was thrashing the file system with a lot of small file access activity. I also noted that FSX seems to have a pretty decent scenery caching scheme, and that the real benefits to fast random access in the disk system are to those scenery files being accessed for the first time (i.e. when loading a new tile or coming into range and loading up scenery objects at an airport). After the first time, FSX is hitting them often enough to keep them in the system's disk cache (RAM) while in use. Bob Scott | President and CEO, AVSIM Inc ATP Gulfstream II-III-IV-V Sys1 (MSFS20+24/XPlane12+11): AMD 9800X3D, water 2x240mm, MSI MPG X670E Carbon, 64GB GSkill 6000/30, nVidia RTX4090FE Alienware AW3821DW 38" 21:9 GSync, 2x4TB Crucial T705 PCIe5 + 2x2TB Samsung 990 SSD, EVGA 1000P2 PSU, 12.9" iPad Pro Thrustmaster TCA Boeing Yoke, TCA Airbus Sidestick, Twin TCA Airbus Throttle quads, PFC Cirrus Pedals, Coolermaster HAF932 case Sys2 (P3Dv5/v4): i9-13900KS, water 2x360mm, ASUS Z790 Hero, 32GB GSkill 7800MHz CAS36, ASUS RTX4090 Samsung 55" JS8500 4K TV@60Hz, 3x 2TB WD SN850X 1x 4TB Crucial P3 M.2 NVME SSD, EVGA 1600T2 PSU Fiber link to Yamaha RX-V467 Home Theater Receiver, Polk/Klipsch 6" bookshelf speakers, Polk 12" subwoofer, 12.9" iPad Pro PFC yoke/throttle quad/pedals with custom Hall sensor retrofit, Thermaltake View 71 case, Stream Deck XL button box Sys3 (DCS/P3Dv4/ATS/ETS): AMD 7800X3D, MSI MPG X870E Carbon, Noctua NH-D15S, 64GB GSkill 6000/30, EVGA RTX3090 Alienware AW3420DW 34" 21:9 GSync, Corsair HX1000i PSU, 4TB Crucial T705 PCIe5 + 2TB Samsung 970Evo Plus, TM TCA Officer Pack, Saitek combat pedals, TM Warthog, TM RS300 FF wheel/pedals, Coolermaster HAF XB case
June 10, 201114 yr A few years ago I ran filemon during an FSX session and then did a histogram of the sizes of the files in the log that FSX was accessing. For the life of me I can't find the data from that experiment (I think it may have gone to data heaven on a drive that crashed last year), but the conclusion I drew was that FSX was thrashing the file system with a lot of small file access activity. I also noted that FSX seems to have a pretty decent scenery caching scheme, and that the real benefits to fast random access in the disk system are to those scenery files being accessed for the first time (i.e. when loading a new tile or coming into range and loading up scenery objects at an airport). After the first time, FSX is hitting them often enough to keep them in the system's disk cache (RAM) while in use.Thank you Col. Bob. Regards,Gary Andersen HAF932 Advanced, ASUS Z690-P D4, i5-12600k @4.9,NH-C14S, 2x8GB DDR4 3600, RM850x PSU,Sata DVD, Samsung 860 EVO 1TB storage, W10-Pro on Intel 750 AIC 800GB PCI-Express,MSI RTX3070 LHR 8GB, AW2720HF, VS238, Card Reader, SMT750 UPS.
June 11, 201114 yr A few years ago I ran filemon during an FSX session and then did a histogram of the sizes of the files in the log that FSX was accessing. For the life of me I can't find the data from that experiment (I think it may have gone to data heaven on a drive that crashed last year)... FileMon has been superseeded by Process Monitor since Win 2KSP4. ProcessMonitor can be downloaded here.Cheers,- jahman.
June 11, 201114 yr FileMon has been superseeded by Process Monitor since Win 2KSP4. ProcessMonitor can be downloaded here.Cheers,- jahman.OK, then the program I used to create the file access log was probably the newer ProcMon rather than the old FileMon...the details are a bit fuzzy now that some years have passed. Bob Scott | President and CEO, AVSIM Inc ATP Gulfstream II-III-IV-V Sys1 (MSFS20+24/XPlane12+11): AMD 9800X3D, water 2x240mm, MSI MPG X670E Carbon, 64GB GSkill 6000/30, nVidia RTX4090FE Alienware AW3821DW 38" 21:9 GSync, 2x4TB Crucial T705 PCIe5 + 2x2TB Samsung 990 SSD, EVGA 1000P2 PSU, 12.9" iPad Pro Thrustmaster TCA Boeing Yoke, TCA Airbus Sidestick, Twin TCA Airbus Throttle quads, PFC Cirrus Pedals, Coolermaster HAF932 case Sys2 (P3Dv5/v4): i9-13900KS, water 2x360mm, ASUS Z790 Hero, 32GB GSkill 7800MHz CAS36, ASUS RTX4090 Samsung 55" JS8500 4K TV@60Hz, 3x 2TB WD SN850X 1x 4TB Crucial P3 M.2 NVME SSD, EVGA 1600T2 PSU Fiber link to Yamaha RX-V467 Home Theater Receiver, Polk/Klipsch 6" bookshelf speakers, Polk 12" subwoofer, 12.9" iPad Pro PFC yoke/throttle quad/pedals with custom Hall sensor retrofit, Thermaltake View 71 case, Stream Deck XL button box Sys3 (DCS/P3Dv4/ATS/ETS): AMD 7800X3D, MSI MPG X870E Carbon, Noctua NH-D15S, 64GB GSkill 6000/30, EVGA RTX3090 Alienware AW3420DW 34" 21:9 GSync, Corsair HX1000i PSU, 4TB Crucial T705 PCIe5 + 2TB Samsung 970Evo Plus, TM TCA Officer Pack, Saitek combat pedals, TM Warthog, TM RS300 FF wheel/pedals, Coolermaster HAF XB case
June 11, 201114 yr OK, then the program I used to create the file access log was probably the newer ProcMon rather than the old FileMon...the details are a bit fuzzy now that some years have passed.Bob, I didn't mean to correct you, rather I thought you might be looking to download FileMon and (since its no longer available) couldn't find it. Cheers,- jahman.
June 11, 201114 yr Bob, I didn't mean to correct you, rather I thought you might be looking to download FileMon and (since its no longer available) couldn't find it. Cheers,- jahman.Naw, I didn't take it that way. I still call ProcMon "FileMon" out of habit...sorta like I call C++ and C# just "C" Old dog...new tricks and all that. I'm thinking about running a similar experiment to check out some cache configurations and utilities. I'm toying with writing a utility that would read (and thereby pre-load) FSX files so that they'd be in cache already for first-use by FSX. I hate that big stutter you get when approaching a complex add-on airport. Bob Scott | President and CEO, AVSIM Inc ATP Gulfstream II-III-IV-V Sys1 (MSFS20+24/XPlane12+11): AMD 9800X3D, water 2x240mm, MSI MPG X670E Carbon, 64GB GSkill 6000/30, nVidia RTX4090FE Alienware AW3821DW 38" 21:9 GSync, 2x4TB Crucial T705 PCIe5 + 2x2TB Samsung 990 SSD, EVGA 1000P2 PSU, 12.9" iPad Pro Thrustmaster TCA Boeing Yoke, TCA Airbus Sidestick, Twin TCA Airbus Throttle quads, PFC Cirrus Pedals, Coolermaster HAF932 case Sys2 (P3Dv5/v4): i9-13900KS, water 2x360mm, ASUS Z790 Hero, 32GB GSkill 7800MHz CAS36, ASUS RTX4090 Samsung 55" JS8500 4K TV@60Hz, 3x 2TB WD SN850X 1x 4TB Crucial P3 M.2 NVME SSD, EVGA 1600T2 PSU Fiber link to Yamaha RX-V467 Home Theater Receiver, Polk/Klipsch 6" bookshelf speakers, Polk 12" subwoofer, 12.9" iPad Pro PFC yoke/throttle quad/pedals with custom Hall sensor retrofit, Thermaltake View 71 case, Stream Deck XL button box Sys3 (DCS/P3Dv4/ATS/ETS): AMD 7800X3D, MSI MPG X870E Carbon, Noctua NH-D15S, 64GB GSkill 6000/30, EVGA RTX3090 Alienware AW3420DW 34" 21:9 GSync, Corsair HX1000i PSU, 4TB Crucial T705 PCIe5 + 2TB Samsung 970Evo Plus, TM TCA Officer Pack, Saitek combat pedals, TM Warthog, TM RS300 FF wheel/pedals, Coolermaster HAF XB case
Create an account or sign in to comment