Performance Metrics - I

The Habey BIS-6862-I3 and the Shuttle DS77U were evaluated using our standard test suite for low power desktops / industrial PCs. Not all benchmarks were processed on all the machines due to updates in our testing procedures. Therefore, the list of PCs in each graph might not be the same. In the first section, we will be looking at SYSmark 2014 SE, as well as some of the Futuremark benchmarks.

BAPCo SYSmark 2014 SE

BAPCo's SYSmark 2014 SE is an application-based benchmark that uses real-world applications to replay usage patterns of business users in the areas of office productivity, media creation and data/financial analysis. In addition, it also addresses the responsiveness aspect which deals with user experience as related to application and file launches, multi-tasking etc. Scores are meant to be compared against a reference desktop (the SYSmark 2014 SE calibration system in the graphs below). While the SYSmark 2014 benchmark used a Haswell-based desktop configuration, the SYSmark 2014 SE makes the move to a Lenovo ThinkCenter M800 (Intel Core i3-6100, 4GB RAM and a 256GB SATA SSD). The calibration system scores 1000 in each of the scenarios. A score of, say, 2000, would imply that the system under test is twice as fast as the reference system.

SYSmark 2014 SE - Office Productivity

SYSmark 2014 SE - Media Creation

SYSmark 2014 SE - Data / Financial Analysis

SYSmark 2014 SE - Responsiveness

SYSmark 2014 SE - Overall Score

SYSmark 2014 SE also adds energy measurement to the mix. A high score in the SYSmark benchmarks might be nice to have, but, potential customers also need to determine the balance between power consumption and the efficiency of the system. For example, in the average office scenario, it might not be worth purchasing a noisy and power-hungry PC just because it ends up with a 2000 score in the SYSmark 2014 SE benchmarks. In order to provide a balanced perspective, SYSmark 2014 SE also allows vendors and decision makers to track the energy consumption during each workload. In the graphs below, we find the total energy consumed by the PC under test for a single iteration of each SYSmark 2014 SE workload and how it compares against the calibration systems.

SYSmark 2014 SE - Energy Consumption - Office Productivity

SYSmark 2014 SE - Energy Consumption - Media Creation

SYSmark 2014 SE - Energy Consumption - Data / Financial Analysis

SYSmark 2014 SE - Energy Consumption - Responsiveness

SYSmark 2014 SE - Energy Consumption - Overall Score

The Core i3-equipped Habey BIS-6862-I3, with its hyperthreading feature (2C/4T), scores better than the dual-core Celeron equipped Shuttle DS77U, as expected. The DS77U is better than the Atom-class fanless PCs (despite being much closer in cost to them). The surprising segment of the results is the fact that the Habey unit is more energy-efficient compared to the Shuttle PC for all the evaluated SYSmark 2014 SE workloads. The Skylake-based Logic Supply ML100G-50 leads the performance charts above, but, is not as energy efficient as the Kaby Lake systems. One of the important caveats here is that SYSmark 2014 SE consistently errored out when the benchmark was run on the DS77U with its original single SODIMM 4GB configuration. The scores presented above for the DS77U are with a 1x 16GB DDR4-2133 SODIMM (all other benchmark numbers for the DS77U in this article are with the 1x 4GB SODIMM put in place by Shuttle).

Futuremark PCMark 10

UL's PCMark 10 evaluates computing systems for various usage scenarios (generic / essential tasks such as web browsing and starting up applications, productivity tasks such as editing spreadsheets and documents, gaming, and digital content creation). We benchmarked select PCs with the PCMark 10 Extended profile and recorded the scores for various scenarios. These scores are heavily influenced by the CPU and GPU in the system, though the RAM and storage device also play a part. The power plan was set to Balanced for all the PCs while processing the PCMark 10 benchmark.

Futuremark PCMark 10 - Essentials

Futuremark PCMark 10 - Productivity

Futuremark PCMark 10 - Gaming

Futuremark PCMark 10 - Digital Content Creation

Futuremark PCMark 10 - Extended

Futuremark PCMark 8

We continue to present PCMark 8 benchmark results (as those have more comparison points) while our PCMark 10 scores database for systems grows in size. PCMark 8 provides various usage scenarios (home, creative and work) and offers ways to benchmark both baseline (CPU-only) as well as OpenCL accelerated (CPU + GPU) performance. We benchmarked select PCs for the OpenCL accelerated performance in all three usage scenarios. These scores are heavily influenced by the CPU in the system. The Broadwell and Skylake-based Core i5 ML100G units from Logic Supply outperform the Habey and Shuttle systems, as expected. When graphics benchmarks enter the picture, the Intel HD Graphics 620 in the Habey unit manages to edge past the integrated GPU in the Broadwell-based Logic Supply ML100G-30.

Futuremark PCMark 8 - Home OpenCL

Futuremark PCMark 8 - Creative OpenCL

Futuremark PCMark 8 - Work OpenCL

Miscellaneous Futuremark Benchmarks

Futuremark PCMark 7 - PCMark Suite Score

Futuremark 3DMark 11 - Extreme Score

Futuremark 3DMark 11 - Entry Score

Futuremark 3DMark 2013 - Ice Storm Score

Futuremark 3DMark 2013 - Cloud Gate Score

3D Rendering - CINEBENCH R15

We have moved on from R11.5 to R15 for 3D rendering evaluation. CINEBENCH R15 provides three benchmark modes - OpenGL, single threaded and multi-threaded. Evaluation of select PCs in all three modes provided us the following results. The OpenGL results for the Habey unit are very encouraging, though the pure CPU-based numbers are still not as good as those obtained with the Broadwell and Skylake Core i5-based units.

3D Rendering - CINEBENCH R15 - Single Thread

3D Rendering - CINEBENCH R15 - Multiple Threads

3D Rendering - CINEBENCH R15 - OpenGL

Introduction Performance Metrics - II
POST A COMMENT

13 Comments

View All Comments

  • nathanddrews - Friday, January 5, 2018 - link

    The networking capabilities (dual Intel GbE and Wi-Fi) of the i3, coupled with its near 2X performance more than justifies its $102 premium, IMO. Shame about its media capabilities, but I guess we can't have it all... Reply
  • shabby - Friday, January 5, 2018 - link

    Yes the usb 1.0 wifi speeds are pretty amazing... Reply
  • DanNeely - Friday, January 5, 2018 - link

    For anything that needs Wifi the Habey's an obvious winner. OTOH for industrial use in many cases the systems will be wired and running software written for a much older system such that both systems will perform identically (major industrial hardware typically has multi-decade lifespans, and is typically designed for a low end PC was when it was new, so anything several years to several decades newer will fly) the cheaper shuttle'd be just as good. Reply
  • MrTeal - Friday, January 5, 2018 - link

    The dual DB9 with one being configurable as RS-232/422-485 is a pretty huge plus in a lot of industrial applications as well.

    It's a pretty cheap upgrade to a lot of older Atom based industrial PCs with a huge bump in performance.
    Reply
  • HStewart - Friday, January 5, 2018 - link

    I think there is a missing set of computers missing hear - something like Intel Compute Stick with Intel Y processors - I am typing on one right now and it has the same performance or actually more than my original Surface Pro 1 CPU - it is definitely faster than Celeron's and I believe it should be faster than the i3. It integrated graphics is 615 instead 620 as in i3-7100U. But it also only 5Watts.

    One big difference with Compute Stick - it can actually fit in your pocket - excluding power supply
    Reply
  • HStewart - Friday, January 5, 2018 - link

    It m3-6y30 beats both of these boxes in Sysmark, but looks like to me lack in FutureMark because of graphics - but for industrial PC - where graphics is not always needed - it seems to better option

    https://www.anandtech.com/show/10447/the-intel-com...
    Reply
  • redviper9 - Friday, January 5, 2018 - link

    Are there any PC's in this form factor (i.e. small and fanless) that run AMD chips? I would be particularly interested in one running one of the new mobile Ryzen with on board Vega graphics (2700U or 2500U). Reply
  • StevoLincolnite - Saturday, January 6, 2018 - link

    I would love one as well. Just a shame that such a rig would be bandwidth constrained with low-clocked DDR4. Reply
  • Maxtang - Thursday, December 19, 2019 - link

    You can check at Shenzhen Maxtang Technology for the exact configuration you looking for.

    https://www.aliexpress.com/item/4000391642092.html...
    Reply
  • Bullwinkle-J-Moose - Friday, January 5, 2018 - link

    2 points

    Was not expecting Legacy Support for Windows XP / no surprise there
    But the Sopport page for the Habey BIS-6862 does not show driver support for Windows 7 or 8 either

    Are you stuck with Windows 10 on these things?

    and....

    When will these embedded systems switch to 5 Volt input?

    Ice Lake?

    Methane Lake?

    Cryo Lake?
    Reply

Log in

Don't have an account? Sign up now