HandlingHighDPI: Difference between revisions

From WebGL Public Wiki
Jump to navigation Jump to search
fix sample code to really work, use only one example
This section is plain wrong and needs to be deleted
 
(5 intermediate revisions by 2 users not shown)
Line 1: Line 1:
=Handling High DPI displays and zoom in WebGL=
=Handling High DPI (Retina) displays in WebGL=


There are an increasing number of devices on the market that have displays with very high pixel densities (DPI). WebGL applications can take advantage of the higher resolution these devices provide but doing so requires some code changes to the application itself. Fortunately these changes are minor and generally non-disruptive, which makes it easy to prepare your WebGL code for these new devices.
There are an increasing number of devices on the market that have displays with very high pixel densities (DPI), such as the Macbook Pro with Retina display. WebGL applications can take advantage of the higher resolution these devices provide but doing so requires some code changes to the application itself. Fortunately these changes are minor and generally non-disruptive, which makes it easy to prepare your WebGL code for these new devices.


You can see a demo highlighting the difference accounting for High DPI displays can make at [https://www.khronos.org/registry/webgl/sdk/demos/google/high-dpi this location]. (The two meshes will only appear different on a high DPI display.)
You can see a demo highlighting the difference accounting for High DPI displays can make at [https://www.khronos.org/registry/webgl/sdk/demos/google/high-dpi this location]. (The two meshes will only appear different on a high DPI display.)
Line 10: Line 10:


* the size they are displayed in the page
* the size they are displayed in the page
* the size of their content (the drawingBuffer)
* the size of their content


For a canvas element, the size of the content or drawingBuffer is determined by the width and height attributes of the canvas. The display size is determined by the CSS attributes applied to the canvas. For example:
For a canvas element, the size of the content or drawingBuffer is determined by the width and height attributes of the canvas. The display size is determined by the CSS attributes applied to the canvas. For example:
Line 20: Line 20:
Defines a canvas that has a drawingBuffer, its content, of size 111x222 pixels but is displayed at 333x444 CSS pixels.
Defines a canvas that has a drawingBuffer, its content, of size 111x222 pixels but is displayed at 333x444 CSS pixels.


On High DPI displays browsers will automatically upscale most content to ensure that it appears the right size on screen, which is done behind the scenes to prevent the majority of web sites from breaking. In the case of WebGL content, this causes the canvas to render at its usual resolution and then upscale to fit the canvas's display size. The practical effect of this is that an unmodified WebGL application may appear to be rendering at a lower-than-native resolution, which can introduce undesired aliasing.
On High DPI displays browsers will automatically upscale the canvas content to ensure that it appears the right size on screen. In the case of WebGL content, this causes the canvas to render at its usual resolution and then upscale to fit the canvas's display size. The practical effect of this is that an unmodified WebGL application may appear to be rendering at a lower-than-native resolution, which can introduce aliasing.


To avoid this developers can scale the canvas width and height by the value of '''window.devicePixelRatio'''.  
To find out what size the canvas is being displayed at in device pixels, you can use a [https://developer.mozilla.org/en-US/docs/Web/API/ResizeObserver '''ResizeObserver'''].


<source lang="javascript">
<source lang="javascript">
  const devicePixelRatio = window.devicePixelRatio || 1;
<style>
#theCanvas {
    width: 50%;
    height: 50%;
}
<style>
<canvas id="theCanvas"></canvas>
<script>


   // get the actual size of the canvas
function main() {
   const bounds = canvas.getBoundingClientRect();
   const canvas = document.getElementById("theCanvas");
   const observer = new ResizeObserver(resizeTheCanvasToDisplaySize)
  observer.observe(canvas);


   // set the size of the drawingBuffer
   function resizeTheCanvasToDisplaySize(entries) {
  var devicePixelRatio = window.devicePixelRatio || 1;
    cont entry = entries[0];
  canvas.width = Math.round(bounds.width * devicePixelRatio);
    let width;
  canvas.height = Math.round(bounds.height * devicePixelRatio);
    let height;
  ...
    if (entry.devicePixelContentBoxSize) {
}
      width = entry.devicePixelContentBoxSize[0].inlineSize;
      height = entry.devicePixelContentBoxSize[0].blockSize;
    } else if (entry.contentBoxSize) {
      // fallback for Safari that will not always be correct
      width = Math.round(entry.contentBoxSize[0].inlineSize * devicePixelRatio);
      height = Math.round(entry.contentBoxSize[0].blockSize * devicePixelRatio);
    }
    canvas.width = width;
    canvas.height = height;
  }
</script>
</source>
</source>
The devicePixelRatio describes the ratio between CSS pixels and native device pixels. On most desktops and laptops with low DPI displays devicePixelRatio is 1, which means nothing will be scaled. On devices like the Retina Macbook Pro or Galaxy Nexus the devicePixelRatio is 2. These values aren't required to be integers, however: On the Nexus One the devicePixelRatio reports as 1.5.
Some browser also change the devicePixelRatio in response to the zoom feature of the browser.
There are differences in behavior between browsers in the precise mapping from CSS pixels to device pixels. Any ambiguities in the specifications are being worked on in the [http://dev.w3.org/csswg/cssom/ CSS Object Model] and [http://dev.w3.org/csswg/cssom-view/ CSSOM View Module] specifications and the [http://www.whatwg.org/ WHATWG working group].
Several samples make these adjustments including the [https://www.khronos.org/registry/webgl/sdk/demos/google/san-angeles/index.html san angeles demo], the [https://www.khronos.org/registry/webgl/sdk/demos/google/shiny-teapot/index.html teapot demo], and the [https://www.khronos.org/registry/webgl/sdk/demos/google/particles/index.html particles demo]


==Handling Input==
==Handling Input==
Line 51: Line 62:
<source lang="javascript">
<source lang="javascript">
canvas.addEventListener("mousemove", function(e) {
canvas.addEventListener("mousemove", function(e) {
   var devicePixelRatio = window.devicePixelRatio || 1;
   const canvasX = e.offsetX * canvas.width / canvas.offsetWidth;
  var canvasX = (e.pageX - canvas.offsetLeft) * devicePixelRatio;
   const canvasY = e.offsetY * canvas.height / canvas.offsetHeight;
   var canvasY = (e.pageY - canvas.offsetTop) * devicePixelRatio;
   // Perform some operation with the transformed coordinates
   // Perform some operation with the transformed coordinates
}, false);
}, false);

Latest revision as of 16:11, 24 March 2023

Handling High DPI (Retina) displays in WebGL

There are an increasing number of devices on the market that have displays with very high pixel densities (DPI), such as the Macbook Pro with Retina display. WebGL applications can take advantage of the higher resolution these devices provide but doing so requires some code changes to the application itself. Fortunately these changes are minor and generally non-disruptive, which makes it easy to prepare your WebGL code for these new devices.

You can see a demo highlighting the difference accounting for High DPI displays can make at this location. (The two meshes will only appear different on a high DPI display.)

Resizing the Canvas

It's important to note that canvas elements, like most graphics elements, have 2 sizes.

  • the size they are displayed in the page
  • the size of their content

For a canvas element, the size of the content or drawingBuffer is determined by the width and height attributes of the canvas. The display size is determined by the CSS attributes applied to the canvas. For example:

<canvas width="111" height="222" style="width: 333px; height: 444px;"></canvas>

Defines a canvas that has a drawingBuffer, its content, of size 111x222 pixels but is displayed at 333x444 CSS pixels.

On High DPI displays browsers will automatically upscale the canvas content to ensure that it appears the right size on screen. In the case of WebGL content, this causes the canvas to render at its usual resolution and then upscale to fit the canvas's display size. The practical effect of this is that an unmodified WebGL application may appear to be rendering at a lower-than-native resolution, which can introduce aliasing.

To find out what size the canvas is being displayed at in device pixels, you can use a ResizeObserver.

<style>
 #theCanvas {
    width: 50%;
    height: 50%;
}
<style>
<canvas id="theCanvas"></canvas>
<script>

function main() {
  const canvas = document.getElementById("theCanvas");
  const observer = new ResizeObserver(resizeTheCanvasToDisplaySize)
  observer.observe(canvas);

  function resizeTheCanvasToDisplaySize(entries) {
    cont entry = entries[0];
    let width;
    let height;
    if (entry.devicePixelContentBoxSize) {
      width = entry.devicePixelContentBoxSize[0].inlineSize;
      height = entry.devicePixelContentBoxSize[0].blockSize;
    } else if (entry.contentBoxSize) {
      // fallback for Safari that will not always be correct
      width = Math.round(entry.contentBoxSize[0].inlineSize * devicePixelRatio);
      height = Math.round(entry.contentBoxSize[0].blockSize * devicePixelRatio);
    }
    canvas.width = width;
    canvas.height = height;
  }
</script>

Handling Input

It's important to note that even though the resolution of the canvas has increased other values provided by the DOM will not adjust accordingly. A good example is mouse or touch input. Coordinates are still delivered in terms of CSS pixels, and thus must be transformed if you need them to line up exactly with the resized canvas pixels. You also need to keep in mind that the canvas position will still be reported in CSS pixels, so adjustments to account for element offsets should not use the devicePixelRatio.

canvas.addEventListener("mousemove", function(e) {
   const canvasX = e.offsetX * canvas.width / canvas.offsetWidth;
   const canvasY = e.offsetY * canvas.height / canvas.offsetHeight;
   // Perform some operation with the transformed coordinates
}, false);

Rationale

Why doesn't the browser automatically make the drawingBuffer the size needed so that 1 pixel in the drawingBuffer equals 1 pixel displayed? The reason is the WebGL API has several features which are always in device pixels. If the browser automatically created a drawingBuffer of a different size than requested many programs would break.

Examples include but are not limited to lineWidth, scissor, viewport, gl_PointSize, gl_FragCoord, copyTexImage2D, and copyTexSubImage2D.