Quantcast
Channel: General – Esri Australia Technical Blog
Viewing all 274 articles
Browse latest View live

SmarterWX Locate Beta Program

$
0
0

Australia’s Dial Before You Dig benefits from a high number of registered asset owners and a high level of awareness of the need to refer to DBYD before conducting any excavations.

However, lodging an enquiry means the enquirer becomes inundated with email responses from each asset owner, and ensuring that all information is accurately interpreted and taken into consideration is an error prone process.

To support you in dealing with these challenges, we’ve added a new product to the SmarterWX portfolio specifically for enquirers working with the Dial Before You Dig (1100.com.au) service.

SmarterWX Locate provides an easy to navigate web portal that simplifies enquiries, saving significant processing and management time by streamlining DBYD submissions and the pursuant management of responses from various asset owners.

This streamlined workflow is the foremost benefit for the market. No longer do you need to collect multiple documents, print out countless PDFs and take them out to the field to navigate to where underground assets might be; with SmarterWX Locate you can submit an enquiry on your smartphone in the field, and receive responses within minutes*.

swx locate search view

SmarterWX Locate integrates fully with your GIS mapping applications allowing you to instantly see the status of DBYD enquiries across your region and view the asset plans directly from the map.

Over the past 12 months, we’ve collected vital end-user feedback through our Early Access Program. We’ve used this feedback to ensure SmarterWX Locate generates the desired savings in time, money and resources that enable businesses to deliver streamlined, efficient processes for these enquiries.

We kicked off the SmarterWX Locate beta program in late August and will be using our findings from that to fine-tune the product and deliver immediate improvements to you, our customers.

We strive to always deliver value to our customers and accordingly offer tiered plans that cater for all enquirers — from local landscape gardeners to large construction companies. It’s exciting to be creating new relationships with this offering, as well as strengthening existing ones.

If you’re interested to know more about SmarterWX Locate, how it could benefit your organisation, or if you want to be part of our beta program, please get in touch with Henry Vettivelu, SmarterWX Product Manager, to have a conversation.

Looking for more information? Visit smarterwx.com/smarterwx-locate for more details and to register your interest.

*Subject to asset owners’ average response times.


Problem: Severe issue with ArcGIS Pro 2.2 Patch 2

$
0
0

Description

Esri has discovered a severe issue with an editing workflow in ArcGIS Pro 2.2 Patch 2 (2.2.2) that may incorrectly set feature attribute field values to ‘Null’ when using the Attributes pane.

Cause

This problem occurs when multiple features are selected in the tree view of the Attributes pane. If the Tab key is used to navigate between cells in the data grid, tabbing through a cell that displays “(Different values)” sets the field to ‘Null’.

Solution or Workaround

Esri strongly recommends to uninstall the patch.

  1. On Windows, open the Control Panel.
  2. Search for View installed updates. Click this option.
  3. Right-click ‘ArcGIS Pro 2.2 Patch 2 (2.2.2)’ and select Uninstall.

If the previous patch—ArcGIS Pro 2.2 Patch 1 (2.2.1)—is not installed, it can be downloaded from My Esri.

How will Esri correct the issue?

ArcGIS Pro 2.2 Patch 3 (2.2.3) becomes available in early October 2018 and includes a fix for this issue, as well as the other software improvements included with Patches 1 and 2. ArcGIS Pro 2.2 Patch 2 (2.2.2) is no longer available for download.

For continued updates and information regarding this problem, refer to the ArcGIS Pro 2.2.2 announcement on GeoNet.

Esri have also published the following technical article relating to this issue:  https://support.esri.com/en/technical-article/000019162

If you have any questions or concerns, please contact your local Esri distributors support team (for Esri Australia clients, use My Esrisupport@esriaustralia.com.au or 1800 447 111)

FAQ: Unable to register an SQL Server database with ArcGIS Server

$
0
0

Problem

When registering a SQL Server database connection in ArcGIS Server the following error appears:

“The connection property set was missing a required property or the property value was unrecognized.”

OR

“The connection property set was missing a required property or the property value was unrecognized. Connection was attempted with an older version of SQL Server client communications software that is not compatible with the SQL Server database server.”

It is known that the SQL Server client communications software is up to date and compatible with the SQL Server database server.

 

Solution

Note: This solution is relevant if your database connection uses operating system authentication. This solution does not apply if your database connection uses database authentication.

The ArcGIS Server Account should be added as a login in SQL Server for the database that is being registered. The ArcGIS Server Account user may be a local operating system user on the server in question or a domain user. An example of the name for the ArcGIS Server operating system user when it is a local operating system user is SERVER_NAME\arcgis.

To determine the name of the ArcGIS Server user in Windows, search for View Local Services, find the service called “ArcGIS Server” and check the name of the user under the column “Log On As”. You may see a user specified in the following type of format:

.\arcgis

arcgis_server_in_local_services

The . in “.\arcgis” in this example is the name of the local server, so when adding this login to SQL Server specify the full name of the server, for example, SERVER_NAME\arcgis.

In SQL Server Management Studio go to Security > Logins > Right-click > New Login > General > Create a login with the desired name.

new_login_in_sql_server_management_studio

In the Login Properties, go to User Mapping and map the login to the database in question.  The User should be set to be the same as the Login.

sql_server_arcgis_server_account_login

 

After the ArcGIS Server Account is given access to the database, you will be able to register the database connection with ArcGIS Server.

 

 

Site Scan – Esri Edition app provides drone flight planning using your GIS content

$
0
0

Esri business partner 3DR has released a free app for iOS that interfaces with ArcGIS Online, allowing Esri users to view GIS content from ArcGIS Online to assist with the drone flight planning. 

The Site Scan – Esri Edition app provides mission planning and flight control for a number of leading drones to optimize drone collections for use in Drone2Map or Ortho Mapping in ArcGIS Pro.  This release is compatible with the DJI Phantom 4 Pro, DJI M200, DJI M210, DJI Inspire 2, DJI Mavic Pro, or Yuneec H520-G, as well as the 3DR Solo.

The Site Scan – Esri Edition app allows users to take advantage of substantial amounts of publicly accessible data, as well as custom data layers from the user’s ArcGIS Online account, as base and reference data for mission planning.

Site Scan – Esri Edition is free to everyone with an ArcGIS Online account. The app is available on iTunes at http://esriurl.com/SSEE, and will be available soon in the Esri Marketplace.   

 Try it out! 

Redlining in the ArcGIS Platform

$
0
0

I often get asked about the ability to redline within the ArcGIS Platform.Within the ArcGIS Platform there are essentially 4 options for Redlining as follows:

Create a feature layer for Redlining in the ArcGIS Platform.

These feature layers are essentially temporary layers. They can be replica of the primary feature layers being viewed in the client applications, so they have the same attributes, pick lists and behaviours. They though do not get entered directly into the feature class. This is the responsibility of the administrator to check the layers then use the ArcGIS Platform append tools to add them to existing feature layers.

Mark-up Layers.

Within Explorer for ArcGIS are Mark up Layers. These are essentially redline layers within explorer which can be share with the ArcGIS Platform. They can be added to Web Apps through the add data tool and viewed in ArcGIS Pro 2.0 or later.  See the following for more information: https://doc.arcgis.com/en/explorer/ipad/help/markup.htm

Smart Sketching in Survey123

Within Survey123 is the ability to provide Smart Sketches. While not map based this is sketch linked to the location of the collection feature. The Following URL shows how this might be used https://community.esri.com/groups/survey123/blog/2017/10/09/smart-skething-in-survey123-stroke-by-stroke

Map Notes

Map Notes can be added to Map and edited within the Map Only.  . It enables quick Mark-up of a Map for other to read and utilise. The following describes this further: http://enterprise.arcgis.com/en/portal/latest/use/map-notes.htm

Important Portal for ArcGIS Security Alert

$
0
0

17 December 2018

Esri has announced that they have discovered a critical security vulnerability in Portal for ArcGIS when specially constructed steps are taken by authenticated users. This results in a privilege escalation issue where the user can elevate themselves to become administrators of the portal.

This issue is present in all supported versions of Portal for ArcGIS, on both Windows and Linux operating systems. Esri has released patches for all versions of Portal for ArcGIS, from version 10.3 through 10.6.1.

Esri have published the following Knowledge Base article relating to this issue: Problem: Warning of security vulnerability in Portal for ArcGIS

Esri is providing patches for all versions of Portal for ArcGIS from 10.3 through 10.6.1. Esri strongly recommends installing the relevant patch at your earliest possible opportunity.

All patches can be downloaded from the Esri Support website:

The Portal for ArcGIS Security 2018 Update 3 Patch is available for versions 10.6.1, 10.5.1, 10.4.1, and 10.3.1 and includes a fix for this issue.

The Portal for ArcGIS Privilege Escalation Security Patch is available for versions 10.6, 10.5, 10.4, and 10.3 and includes a fix for this issue.

If you have any questions or concerns, please contact your local Esri distributor’s support team (for Esri Australia clients, use My Esri, support@esriaustralia.com.au or 1800 447 111)

Understanding GDA2020 and it’s relationship with Web GIS

$
0
0

Background

Australia sits on one of the Earth’s fastest moving tectonic plates which has been moving 70 millimetres per year. By 2020, Australia will have moved 1.8 metres north east of it’s location in 1994. To effectively map the earth, representations, known as datums are used to model and identify locations. Australia’s national datum; Geocentric Datum of Australia 1994 (GDA94) will soon be replaced by a new datum Geodetic Datum of Australia (GDA2020). GDA2020 will align with current positioning technology.

Geoscience Australia and the Intergovernmental Committee on Surveying and Mapping (ICSM) have released a new Geodetic datum GDA2020. The datum provides higher positional accuracy and will be able to represent locations dynamically rather than the stationary GDA94. .

In the coming two to three years most organisations will be transforming their spatial data from the GDA94 datum to the new GDA2020 datum. Esri’s, ArcGIS Software has been updated to accommodate these new datums across Australia and will support all of our customers rigorous requirements for locational and positional accuracy.

Effects of Web GIS

With the evolution of ArcGIS Online and the ArcGIS Enterprise platform, we have seen an explosion of content which organisations can consume to provide context for their authoritative datasets. Esri for example provides nine individual global basemaps ranging from imagery to street based data. This is ideal for organisations who require base map information. However, providing seamless global datasets has meant organisations such as Esri have had to settle on a datum that best fits the entire world. This is the World Geodetic System 1984 (WGS84). All Esri’s basemaps, scene layers and global display engines are now based on this datum.

For organisations; displaying authoritative data against Esri’s basemaps and in the 3D scene environments is a simple transformation. From GDA94 to WGS84 . Moving to GDA2020 this simple reprojection requires further consideration.

The move to GDA2020

GDA94 and WGS84 are  generally interchangeable with little effect on positional accuracy. Unfortunately, with the modernisation of the Australian datum to GDA2020 there is not a definitive relationship between GDA2020 and WGS84. This will result in any transformation between GDA2020 and WGS84 having an error of 3 metres or greater.

The following diagram gives a representation of the relevant issue:

GDA2020

So, what can be done

Data in the web map environment can be displayed against Esri basemaps and web scenes and other WGS84-based data. In most instances this will not be an issue as the generic basemap data is derived from many sources with varying positional accuracies.

From a user data perspective Esri Australia recommends:

  1. Transform all data to GDA2020 and republish to Web GIS in GDA2020 or a GDA2020-based projected coordinate system.
  2. When publishing to WGS84, utilise the projection path GDA2020⇒GDA94⇒ Data will be published with GDA94 accuracy and coordinate transformations between WGS84 and GDA94 can be Performed.
  3. Create your own basemaps (Imagery, Street and Topographic) in GDA2020
  4. DO NOT mix data from GDA94 and GDA2020 in Web GIS as there will be a 1.8 metre alignment error regardless
  5. If coordinate conversion is required in Web GIS from WGS84 to GDA2020 then a transformation path of WGS84⇒GDA94⇒GDA2020 should be utilised

Important Security Updates to the ArcGIS Platform

$
0
0

January, 2019

Esri have recently announced upcoming improvements to ArcGIS Online in order to maintain the highest industry standards for data integrity and network security. Starting on 16 April 2019, ArcGIS Online will only accept TLS 1.2 connections for ArcGIS Online services. Some software, like ArcGIS Pro, are already TLS 1.2 enabled. Other Esri software, such as ArcGIS Desktop, uses TLS 1.0—this software requires a patch or configuration change to support TLS 1.2 connections. Esri is releasing patches and instructions to update existing software to support these connections.

What is TLS?
TLS or  “Transport Layer Security” is a widely deployed network security protocol. It provides privacy and data integrity between communicating applications over a network. You use TLS whenever accessing ArcGIS Online services, such as basemaps, geoprocessing services, and the Living Atlas, from ArcGIS Desktop, ArcGIS Enterprise, and other applications.

Who is affected?
Users of most ArcGIS software or custom solutions using Esri technology may be affected by this planned update to TLS protocol v1.2.

What do I need to do to prepare for this change?
Go to the Esri TLS Support page for more information and specific actions you may need to take in advance of this update; or book a consultation with a Technical Support Specialist who can guide you through the update and the appropriate patches for your environment.

Release schedule for ArcGIS Desktop Patches

Product and Version Patch available for download
ArcGIS Desktop 10.6.1 ArcGIS-1061-DT-TLS-Patch.msp
ArcGIS Desktop 10.6 ArcGIS-106-DT-TLS-Patch.msp
ArcGIS Desktop 10.5.1 ArcGIS-1051-DT-TLS-Patch.msp
ArcGIS Desktop 10.5 ArcGIS-105-DT-TLS-Patch.msp
ArcGIS Desktop 10.4.1 ArcGIS-1041-DT-TLS-Patch.msp
ArcGIS Desktop 10.4 ArcGIS-104-DT-TLS-Patch.msp
ArcGIS Desktop 10.3.1 ArcGIS-1031-DT-TLS-Patch.msp
ArcGIS Desktop 10.3 ArcGIS-103-DT-TLS-Patch.msp
ArcGIS Desktop 10.2.2 ArcGIS-1022-DT-TLS-Patch.msp
ArcGIS Desktop 10.2.1 ArcGIS-1021-DT-TLS-Patch.msp

Test TLS 1.2 Connection to ArcGIS Online

After you have updated your software or operating system to support TLS 1.2 connections, you can verify the changes by testing the connections to sample ArcGIS Online services.

Sample ArcGIS Online services for testing Available for testing
Test TLS 1.2 Connection to ArcGIS Online Available

Further references?

If you have any questions or concerns, please contact your local Esri Distributor Support team (for Esri Australia clients, use My Esrisupport@esriaustralia.com.au or 1800 447 111); or book a consultation).

Last updated: 23 January, 2019

 


ArcGIS 10.2.1 for Utilities supports GDA2020

$
0
0

Esri recently released an update for the ArcGIS 10.2.1 for Utilities and Telecom that has included support for GDA2020 projections and transformations.
The update includes

  • support for the mathematical transformation between GDA94 and GDA2020
  • Support for the NtV2.0 Grid file transformations
  • Also included are the Conformal and Conform + Distortion grid files.

If you intend on migrating to GDA2020 at 10.2.1 then we recommend you update to the latest Patch #9 available from
https://support.esri.com/en/download/7680

Imagery Best Practices

$
0
0

Supporting Imagery and Lidar in the ArcGIS platform has been around for a long time. In the ArcGIS Server Space, Image Server became available at 9.3.1. Since then it has evolved to Mosaic Datasets, Image Services, Raster Functions and now raster analytics. Now imagery is really an integral part of the ArcGIS platform. However, it is only as performant when the imagery is managed and configured optimally.

I often get asked,

  • what format should I store my imagery in?,
  • How many images can be in a Mosaic Dataset?
  • How should I structure my imagery? and
  • what is the maximum number of images per folder?

When answering these questions I have drawn on past experience and advice from Esri. Now though Esri have compiled all this information into an Excellent Centralised resource Imagery Workflows – Best Practices https://doc.arcgis.com/en/imagery/workflows/best-practices/what-are-best-practices.htm

In the Imagery formats and Performance section it details topics such as:

  • File format suitability
  • Recommended imagery formats
  • Reformatting imagery
  • Pyramids
  • Statistics
  • Working with large mosaics
  • Storage system performance

If you’re going to be managing imagery and lidar I recommend you reads these documents. They are comprehensive and invaluable. I must admit I have been doing this for 12 years now and there is information on Lidar management that I did not know about.

This is just one component of the ArcGIS Imagery Workflows documentation Esri has just produced.

Gordon

ArcGIS Online Security Changes – Is Your Organisation Prepared?

$
0
0

Earlier last month Esri published a blog post titled Prepare for Next Major ArcGIS Online Security Advancement Now. I have to admit when I first read it; I didn’t pause for long – thinking it was related to another recent web-security related change by Esri – the switch to TLS 1.2

If your eyes are glazing over already, hang in there. There was more to this post than I first thought, and it’s something you should be thinking about now if you’re administering an ArcGIS Online organisation that has been in place for some time. To be specific, if you created your ArcGIS Online site before September 2018, then you should read on.

What’s going to happen in 2020 is that ArcGIS Online will no longer work with external references to resources that use HTTP in the referring URL. Only HTTPS references will be supported. This is the way the web is moving and Esri is simply following best practice.

If you created your ArcGIS Online organisational after September 2018, then you will have been subject to this restriction from the get-go and won’t have a problem (it has been the default position since that time). If the organisational site is older than that, then there’s a chance you could have these less secure references to resources lurking in your web maps, web scenes and other items. If you do nothing, a bunch of things may stop working at some point in 2020, and you’ll be scurrying to try and fix them in a hurry.

For any of you utilising Story Maps you may have already encountered this. In 2018 the Story Map team implemented HTTPS only compliant web apps. This meant not only did the story map have to be secured with HTTPS but also any referenced site in a story map  also had to be secured in the same fashion. In 2020 ArcGIS Online in its entirety will follow suite. Details on that earlier Story Map change here.

How would you know you’ve got a problem to solve? Esri has created a tool called the ArcGIS Online Security Advisor that will scan all the items in your organisation, looking for the issue. You’ll need to be logged in as an administrator of the organisation to do this. The HTTP Check component of that tool is in Beta right now with new capabilities being added regularly.

It can’t directly fix the issues because a simple replacement of HTTP with HTTPS in the reference may not work  if the target server doesn’t support HTTPS. However, it will give you the feedback you need to go triage each of the problems it flags.

A typical scenario that could impact many users is where a GIS service is coming from an older version of ArcGIS Server and added as an item to an ArcGIS Online organisation. That older ArcGIS Server version would have allowed the specification of just HTTP, or both HTTP and HTTPS when exposing services.

Here’s an example. Way back, I created a web map in my ArcGIS Online organisation that refers to the Australian Coastal Sediment Compartments web service from GeoScience Australia.  The link here is for the HTTPS version (since this is all about best practice), but when I created that map, I used the HTTP version. Both forms are currently supported by the GeoScience Australia GIS Server.

GAMap

The map displays the GA map service on top of the Esri Oceans basemap and works fine. Come 2020; this won’t be the case. If I use the beta HTTP Check tool in the ArcGIS Online Security Advisor, it picks up two problems with the web map.

GAMapDetection

 
In scanning the web map item, it detected that I have the URL of the GA web service in the Description. While that won’t break the map when HTTP is no longer supported, it still needs attention given the resource it refers to will change.

GAMapItem

The second pickup by the tool was the actual URL to the GA service in the JSON data describing the web map.

GAMapItemData

Equally, if you’ve created items in your portal that refer to resources coming from external sources  – say a web service from an external agency that you collaborate with, then you may come up against the same issue if they’re using HTTP.

When you interact with a web site that doesn’t use HTTPS to encrypt traffic these days, you get to know it. It’s no longer just a small broken padlock icon – mainstream browsers are now calling it out and telling you that the site is not secure. That’s a good thing, and Esri is just doing its part to ensure web security best practices are adhered to.

Read the original blog post here and use the ArcGIS Online Security Advisor tool to determine whether you need to take any action.

ArcGIS Server and GDA2020

$
0
0
Background

Esri has been working for to incorporate time-based geographic transformations into the software. As you can imagine, these transformations are hugely complex, since the process involves the actual position of the features on the surface of the earth, taking continental drift, and plate tectonic motion into consideration. These time-based transformations are based on a so-called “epoch”, which is the date on which all features are at located in relation to an absolute location.

There are several moving parts involved here.

1] The computer programming to perform the math to implement these geographic transformations.

2] The transformation parameters (14 for time based transformations) to transform data between an original, static datum like GDA94, which assumes that the features of the earth are in one position and not moving and a datum like GDA2020.  Later datums will be dynamic so as to take  plate motion into consideration, this is discussed here, software vendors are already planning for this new approach.

3] The transformation parameters to transform between one time-based datum, and another more current time-based transformation – GDA2020 to say, GDA2030 for example if such a thing were to exist someday.

What the ArcGIS Software does not do is calculate these transformation parameters. ArcGIS checks them and verifies that the transformation parameters provided by the national government agency perform to the accuracy provided, but does not calculate them.

Therefore, even if ArcGIS has the transformation method in place to perform a 14-parameter time-based transformation, ArcGIS needs the transformation parameters, from the national government agency that has created the specific transformation for their area of interest.

ArcGIS software does support GDA2020 Z point transformations ‘out of the box’ but not the NTv2 grid files for the mathematical and mathematical plus distortion transformations.  The NTv2 grid files will have to downloaded (which include some content from Geoscience Australia) for the appropriate ArcGIS version from;

 My Esri > Product Components > Data and Content > ArcGIS Coordinate Systems Data

Description:
Contains the data files required for the … transformation method and vertical transformation files for … the world … for use with either ArcMap, ArcGIS Enterprise, ArcGIS Engine, or an ArcGIS Pro per machine install

and install on each ArcGIS machine, this will install to C:\Program Files (x86)\ArcGIS\CoordinateSystemsData.

This installer is specific to the ArcGIS version, eg:

  • ArcGIS_Coordinate_Systems_Data_Windows_1061_163829.exe
  • ArcGIS_Coordinate_Systems_Data_Windows_1071_169282.exe

The NTv2 transformation between GDA 1994 and GDA 2020 is one small moving part of this major upheaval in the world of geodesy, and the pursuit of ever-more-accurate and ever-more-precise coordinates for features on the earth’s surface.
Esri publish documentation specific to each ArcGIS version which have included GDA2020 for some time, for instance in 10.5.1 they put the transformation GDA_1994_to_GDA_2020_NTv2_CD in 10.5.1 assuming that they knew the names of ntv2 files, then Geoscience Australia changed the file names so this transformation was deprecated in the _C versions. As far as this naming is concerned _C is for Conformal and _CD is Conformal_and_Distortion. Each of these transformations will get a unique Well Known ID (WKID) value each time the transformation changes. For example:

geographic_transformations_1060

geotran_1071_24

How To: Select the correct geographic (datum) transformation when projecting between datums

Esri Australia have been publishing blogs on GDA2020 for a while;

https://esriaustraliatechblog.wordpress.com/tag/gda2020/

Up to version 10.6.1 for some situations you needed to rename the GSB file as mentioned here;

https://esriaustraliatechblog.wordpress.com/2018/01/04/gda2020-arcgis/

The transformation 108065 was added to the Projection Engine at 10.6.0, but was removed from 10.6.1, so that transformation never existed at 10.6.1. The same transformation, but with a new name for the GSB file was added again at 10.7.1.
The conclusion here is that you should upgrade to the latest version of ArcGIS to get the most GDA2020 transformations.
A map of the approximate shifts from GDA94 to GDA2020 locations across Australia is here; https://www.icsm.gov.au/gda2020

ArcGIS Server (does not support time-dependent transformations yet)

Expect in 2020 many agencies will be publishing services natively GDA2020.
If all data is stored in GDA2020 and published in GDA2020 there should not be any issues, apart from later on taking into account the epoch of the data, as mentioned here;

https://esriaustraliatechblog.wordpress.com/2018/12/24/understanding-gda2020-and-its-relationship-with-web-gis/

If you are upgrading your servers and need to change the coordinate systems of your data or services, please republish the services. The version of the ArcGIS Coordinate Systems Data should be identical on the desktop client and server should be the same.

You can test a server’s support for a particular transformation if the GeometryServer is running;

https://localhost/server/rest/services/Utilities/Geometry/GeometryServer/project?inSR=4283&outSR=7856&geometries={“geometryType” : “esriGeometryPoint”,”geometries”: [{“x”: 153.30141143,”y”: -27.90831298}]}&transformation=108447&transformForward=true&vertical=false&f=html

should return (which is less than 1mm away from the expected ordinates);

{“geometries”: [{ “x”: 529661.2445906086, “y”: 6912919.071889246}]}

For instance, trying;

url1will return the message;

Invalid or missing input parameters.
the specified wkid or wkt is not a geotransformation

As;

url2

is at ArcGIS version 10.4.1 so is not capable of doing GDA2020 transformations.

 

 

 

 
If you access a more recent ArcGIS Server version like;

url4

 

and you get an error like;

Unable to complete operation.
Cannot load the data file Dataset_australia/GDA94_GDA2020_conformal_and_distortion for the geographic transformation GDA_1994_To_GDA2020_NTv2_2_Conformal_and_Distortion.

Then the server is capable of that transformation but the ArcGIS Coordinate Systems Data installer has not been run on the server.
What this means is that if you query the following to add a layer to a web map of yours which is going to be in a particular coordinate system like outSR=7856 https://epsg.io/7856 and you get geometry from this layer;

 

url5

{“displayFieldName”:”PROP.QLD_SURVEYCONTROL_SCDB.MRK_ID”,”fieldAliases”:{“PROP.QLD_SURVEYCONTROL_SCDB.GDALATITUDE”:”GDA latitude”,”PROP.QLD_SURVEYCONTROL_SCDB.GDALONGITUDE”:”GDA longitude”,”PROP.QLD_SURVEYCONTROL_SCDB.AHDHEIGHT”:”AHD height”},”geometryType”:”esriGeometryPoint”,”spatialReference”:{“wkid”:7856,”latestWkid”:7856},”fields”:[{“name”:”PROP.QLD_SURVEYCONTROL_SCDB.GDALATITUDE”,”type”:”esriFieldTypeDouble”,”alias”:”GDA latitude”},{“name”:”PROP.QLD_SURVEYCONTROL_SCDB.GDALONGITUDE”,”type”:”esriFieldTypeDouble”,”alias”:”GDA longitude”},{“name”:”PROP.QLD_SURVEYCONTROL_SCDB.AHDHEIGHT”,”type”:”esriFieldTypeDouble”,”alias”:”AHD height”}],”features”:[{“attributes”:{“PROP.QLD_SURVEYCONTROL_SCDB.GDALATITUDE”:-27.9083129838,”PROP.QLD_SURVEYCONTROL_SCDB.GDALONGITUDE”:153.3014114276,”PROP.QLD_SURVEYCONTROL_SCDB.AHDHEIGHT”:30.34},”geometry”:{“x”:529660.65561161563,”y”:6912917.6855818881}}]}

Or this (where you also asked for the datum transformation);

url6

{“displayFieldName”:”PROP.QLD_SURVEYCONTROL_SCDB.MRK_ID”,”fieldAliases”:{“PROP.QLD_SURVEYCONTROL_SCDB.GDALATITUDE”:”GDA latitude”,”PROP.QLD_SURVEYCONTROL_SCDB.GDALONGITUDE”:”GDA longitude”,”PROP.QLD_SURVEYCONTROL_SCDB.AHDHEIGHT”:”AHD height”},”geometryType”:”esriGeometryPoint”,”spatialReference”:{“wkid”:7856,”latestWkid”:7856},”fields”:[{“name”:”PROP.QLD_SURVEYCONTROL_SCDB.GDALATITUDE”,”type”:”esriFieldTypeDouble”,”alias”:”GDA latitude”},{“name”:”PROP.QLD_SURVEYCONTROL_SCDB.GDALONGITUDE”,”type”:”esriFieldTypeDouble”,”alias”:”GDA longitude”},{“name”:”PROP.QLD_SURVEYCONTROL_SCDB.AHDHEIGHT”,”type”:”esriFieldTypeDouble”,”alias”:”AHD height”}],”features”:[{“attributes”:{“PROP.QLD_SURVEYCONTROL_SCDB.GDALATITUDE”:-27.9083129838,”PROP.QLD_SURVEYCONTROL_SCDB.GDALONGITUDE”:153.3014114276,”PROP.QLD_SURVEYCONTROL_SCDB.AHDHEIGHT”:30.34},”geometry”:{“x”:529660.65561161563,”y”:6912917.6855818881}}]}

Then you are not going to see the points transformed onto your map as you expect (as the server does not have the NTv2 files) and the layer will be not shifted as needed.

Make it your 2020 resolution to bring your ArcGIS Servers up to date, install ArcGIS Coordinate Systems Data and discuss GDA2020 with your users!

 

 

 

 

Important ArcGIS Server Security Alert

$
0
0

3 April 2020

Esri has announced that they have discovered a critical security vulnerability in ArcGIS Server when specially constructed steps are taken by persons with network access to the ArcGIS deployment to exploit Server-Side Request Forgery (SSRF), which can potentially be used to obtain access to sensitive internal system information by unauthorized individuals. 

This issue is present in ArcGIS for Server, on both Windows and Linux operating systems. Esri has released patches for 10.7.1 and prior supported versions of ArcGIS for Server here. ArcGIS Server 10.8 is unaffected by this issue. 

Esri have published the following Blog and Knowledge Base article relating to this issue:

Critical Security patch for ArcGIS Server Released.

Problem: Warning of security vulnerability in ArcGIS Server

Esri strongly recommends installing the relevant patch at your earliest possible opportunity. All patches can be downloaded from the Esri Support website:

ArcGIS Server Security 2020 Update 1 Patch.

If you have any questions or concerns, please contact your local Esri distributor’s support team (for Esri Australia clients, use My Esri, support@esriaustralia.com.au or 1800 447 111) For any email requests please add “ArcGIS Server Security Patch, March 2020” to the subject line so that it can be addressed.

Survey123 for ArcGIS: Securing surveys and results

$
0
0

Survey123 for ArcGIS is a complete, form-centric solution for creating, sharing and analyzing surveys. It is used to create smart forms and can be submitted from a web browser or dedicated Survey123 for ArcGIS native app by a defined audience.

Surveys can be designed on the Survey123 website or via the desktop with Survey123 Connect. Once designed, the survey is published, and in this process a survey form and service layers are created in the designer’s portal (ArcGIS Online or ArcGIS Enterprise). The survey form item represents the questions and survey settings, and the survey layers storing the submitted data.

After publishing you can collaborate with other users via the Survey123 website. Collaboration options apply to Submitters and Viewers, giving control on who can submit, what they submit and then also who can view the results. As these collaboration settings are applied in the Survey123 website the settings on the items in portal are updated. In the example below, updating ‘Who can submit to this survey’ to ‘Everyone (Public)’ changed the sharing on the survey form and fieldworker service layer to ‘Everyone (Public)’:

Survey123 Collaboration settings show survey is shared to Everyone (Public)
Survey123 Collaboration settings
The Everyone (Public) settings on the Survey123 website push to the portal item settings
ArcGIS Online item settings: the survey form (questions) and service layer (where the submitted data is stored) are shared to Everyone (Public)

This highlights several things:

  • Survey123 leverages the storage, sharing and security model of the ArcGIS platform
  • You can access the content directly to apply granular settings or use the layers in other maps and web mapping applications
  • The Survey123 platform is reliant on these items. Care needs to be taken not to make sharing or item setting changes that would break the platform’s ability to function.

In general it’s best to configure settings through the Survey123 website, as this will ensure that all items are updated as necessary while retaining platform functionality. A somewhat common mistake is sharing only the ‘form’ via the portal Content screen. This allows users to access the survey form but will fail on submission as they don’t have access to view/edit the associated feature layer. Sharing through the Survey123 website ensured that both items were shared at the appropriate level.

When working with public surveys, greater control is often desired over who can submit and view survey data. If not secured, public survey results containing private or sensitive information could be viewed or manipulated. By configuring the securing options for the underying survey layers that support the survey, you can allow public users to submit surveys without exposing previously collected data. Other stakeholders can be provided access to the data, in part or its entirety, through Feature Layer Views.

Esri recently released two key resources to help you with securing your survey data:

If you’re a Survey123 publisher or organization administrator, you’ll want to take a look at the above two resources to ensure that you understand the level of access to your survey data. It’s important to remember that some surveys intentionally share their results publicly. If you have any additional questions about implementing these best practices, please contact Tech Support.

Additional information:

Important Portal for ArcGIS Security Alert

$
0
0

4 June 2020

Esri has announced that they have detected a critical security vulnerability in the Portal for ArcGIS component of ArcGIS Enterprise when special steps are taken by persons with network access to the ArcGIS Enterprise portal to exploit Server-Side Request Forgery (SSRF), which can result in access to and control over other infrastructure resources by unauthenticated persons.

This can affect deployments running in Amazon Web Services (AWS) in particular which makes this issue particularly urgent for those deployments.

This security issue affects all supported versions prior to ArcGIS Enterprise 10.8 on both Windows and Linux operating systems.

What you need to do

Esri has released patches for versions of ArcGIS Enterprise from 10.5 through to 10.7.1.

Esri strongly recommends installing the Portal for ArcGIS Security 2020 Update 1 Patch at your earliest opportunity. ArcGIS Enterprise 10.8 already contains these fixes and is not affected.

More information

Esri have published the following Blog and Knowledge Base article relating to this issue:

KB Article: Problem: Warning of security vulnerability in ArcGIS Enterprise

Blog: Critical Security Patch for ArcGIS Enterprise portal Released

Getting Help

If you have any questions or concerns, please contact your local Esri distributor’s support team (for Esri Australia clients, use My Esrisupport@esriaustralia.com.au, call 1800 447 111; or book a Consultation with a Technical specialist). For any email requests please add “Portal for ArcGIS Security Patch June 2020” to the subject line so that it can be addressed.

 


How do I add Bing Maps to the Basemap collection in ArcGIS Pro?

$
0
0

Would you like to add Bing Maps as basemaps in ArcGIS Pro?  Here are the steps that will get you up and running!

To add Bing Maps as a basemap in ArcGIS Pro, you will need to do two things:

1 – Configure ArcGIS Online to access Bing Maps.
2 – Create the Bing Maps Basemaps and share with a group that is configured as the organisations default basemap group

Once these configurations are complete, users will be able to access the Bing Maps from the Basemap gallery in ArcGIS Pro.

Things to keep in mind, you will need to be logged in as an ArcGIS Online Organisation Admin to make the following changes on the Organisation settings page.

Steps to add Bing Maps to the Basemap collection in ArcGIS Pro

1 – Configure ArcGIS Online with a Bing Maps Key
2 – If you have not already done so, create a group to share basemaps with your organisation.
3 – Create a map and add the bing map as a base map

  • To use a Bing basemap Click Add > Add Layer from Web.
  • Choose A Bing Basemap from the drop-down list.
  • Choose which Bing basemap you want to use.
  • Click Add Layer. Bing basemaps are only available if your portal is configured with a Bing Maps key.
  • Click Save in Map Viewer. The Save Map dialog box opens. Type a Title, Tags, and Summary for the map, choose which folder to save it in, and click Save Map.

4 – Share this map with the Group you created.
5 – Configure your organisation to use this group as the default basemaps group.
7 – Restart ArcGIS Pro, log in and your bing maps basemaps will be available from the basemaps options.
 

If you would like more information about this process, please refer to the below related links.

Microsoft: Getting a Bing Maps Key

Create a Group in ArcGIS Online
https://doc.arcgis.com/en/arcgis-online/share-maps/create-groups.htm

FAQ: Is it possible to add Bing basemaps to ArcGIS Pro?
https://support.esri.com/en/technical-article/000012709

Using Bing basemaps in ArcGIS Online:
https://www.esri.com/arcgis-blog/products/arcgis-online/mapping/using-bing-basemaps-in-arcgis-online/

Use Bing Maps:
https://pro.arcgis.com/en/pro-app/help/data/services/use-bing-maps.htm

How to compartmentalise content in ArcGIS Online

$
0
0

Do you have guests or temporary workers in your organisation’s ArcGIS Online or Portal for ArcGIS?

Their accounts can often see anything that is shared to the organisation. This can be undesirable.   How do you enable your organisation’s core-staff to have access to a wide range of content but have that content unavailable to these temporary users? 

If this is something that your organisation has concerns about, it’s a great time to start using Groups to divide and organise your content into sections or categories for your different types of users. This process is called Compartmentalization.

In ArcGIS Online and Portal you have four ways to share your items.

  • With Yourself
  • With the Public
  • With your Organisation
  • With a Group
In ArcGIS Online and Portal you have four ways to share your items.
•	With Yourself
•	With the Public
•	With your Organisation
•	With a Group
Sharing levels available for ArcGIS Content

If your account has the User, Publisher or Administrator role then you have the privilege to Create Groups in ArcGIS Online and Portal for ArcGIS. What you can do with these groups is create a group for every group of user you might have in your organisation.

Some examples of this might be a group for each project demonstration you’re working or presenting, a group for all the content you will publicly share, a group for your temporary workers and a group for general useful content for your organisation’s members.

Some examples of this might be a group for each project demonstration you’re working or presenting, a group for all the content you will publicly share, a group for your temporary workers and a group for general useful content for your organisation’s members.
Example of some groups you might use in your organisation

There are several settings that the group owner can configure for their groups. Some of the key settings are:

  • Who can join
  • Who can see the group and its content
  • Who can contribute content to the group

Here is an example of what ArcGIS Online might look like for a user signing into a temporary account where groups haven’t been set up:

When looking at the gallery where there has not been compartmentalisation for a temporary user account you will see lots of content that is not relevant to you
The view of the gallery where there has been no compartmentalisation for a temporary user account

The following example is what it might look like if the user is part of a group where their project’s data is being shared:

When looking at the gallery where there has been compartmentalisation for a temporary user account you will see only content relevant to your role or account
The view of the gallery where there has been compartmentalisation for a temporary user account

As you can see, creating several groups for sharing specific content to can be a very effective method of organising the data in your organisation.

For documentation related to this workflow, see below:

How to connect to an ArcGIS License Manager using IPv4 and IPv6 connections.

$
0
0

Are you having trouble connecting to the ArcGIS License Manager (LM) when using IPv4 and IPv6 connections?  When using Dual-IP stacks, your computers and other devices can run both protocols however there can be issues when connecting to an ArcGIS License Manager.  The connection is usually set to be IPv4 (e.g. internal network) or to IPv6, for example MS DirectAccess, that uses IPv6 connections; not to both protocols.

Please note that the IPv6 is supported for the License Manager. However, only if the machine and operating system environment support IPv6.

If you require a connection for both protocols to a License Manager, a workaround is to configure the registry. It’s very Important that before making any modifications to the registry, back up the registry for restoration in case problems occur.***

Workflow:

On the client-side machine (where ArcGIS Desktop resides), update the ESRI LICENSE_SERVER registry key in the registry using Windows Regedit to add the second IPv6 address of a License Manager assuming if you have IPv4 connection. The following example is using a local network (IPv4) and a DirectAccess (IPv6) network.

  • Open Windows Regedit:
  • Navigate to Key Location (for License Manager 10.x).

    For example if you have installed ArcGIS Desktop 10.8 navigate to:
    Computer\HKEY_LOCAL_MACHINE\SOFTWARE\WOW6432Node\ESRI\License10.8\LICENSE_SERVER
  • Right click to Modify and then Configure two licensing servers in the registry, one for the local network and one for the MS DirectAccess network, separated by a semi-colon, for example, @IPv4 address;@IPv6 address.

Once this is done, open the ArcGIS Administrator on the client machine and check the availability of licenses. The users with either IPv4 or IPv6 connections can then open ArcGIS Desktop irrespective of which of the protocols they are using.

***Note: You will be making changes to your computer’s registry. Esri Australia is not responsible for any incorrect changes made to the registry of your machine. Please use caution and proceed at your own risk. Consult with a qualified computer systems professional, if necessary.

Esri Basemaps – December update for Australia

$
0
0

Parcels, parcels, parcels…

Big thank you to the following agencies, who between them contributed over 10 million property parcels into the Esri Basemaps:

State Agency Sync or Upload
VIC DELWP Upload
TAS DPIPWE Upload
NSW DCS SS Upload
ACT ACTGov Sync
QLD DNRME Upload

Jump into the Esri Topographic basemap and have a look for yourself.

Burnie – Parcel data from DPIPWE in the Topographic Style – preview
Newcastle – Data from NSW Spatial Services using the Community Style – preview
North Mackay – Parcel data from DNRME in the Topographic Style – preview
For the carto connoisseur, build your own style with the Vector Style Editor

HERE Data Refresh

HERE data forms the backbone for the Esri basemaps in Australia. This is updated quarterly. The December update refreshes the previous HERE 2020-Q3 to HERE 2020-Q4 vintage. As an example – this incremental update includes an additional 20k local road segments for Australia.

Want to see your data in the Esri basemaps?

The Esri Community Basemaps program allows organisations to contribute a range of datasets. Please reach out if you need any assistance or have further questions about getting your data into the Esri basemaps.

You can contribute via uploading or syncing from your ArcGIS Enterprise/Online environment on a schedule.

Usage Stats

Digging into the usage numbers, the Esri basemaps get a lot of usage from within Australia. Some of the higher usage (>50 hits/hour) apps include:

The Esri Vector Tile basemaps have seen a surge in usage over 2020

Stay tuned. In 2021 we will be working with a combination of federal and state agencies to help incorporate a range of valuable Australian datasets together into the Esri basemaps.

The Esri Vector Tile Basemaps support offline workflows and custom styles.

FAQ: Why is the connection slow to a SQL Server geodatabase?

$
0
0

Question

Why is the connection slow to a SQL Server geodatabase from ArcGIS Desktop?

Answer

ArcGIS Desktop reads metadata for all feature classes contained in the geodatabase upon connection. It is known behaviour for slowness to be observed with geodatabases with large metadata when stored in SQL Server.

You can check the size of the metadata in bytes for the geodatabase workspace and the top 20 feature classes in an SQL Server geodatabase by running the following T-SQL statement. Remember to replace <Database Name>. This statement assumes the geodatabase repository is owned by the sde user, otherwise use “dbo” in place of “sde”. 

SELECT TOP 20 datalength(documentation) Length, Name

FROM <Database Name>.sde.GDB_ITEMS

ORDER BY Length DESC;

For example:

The Length is given in bytes.

The geodatabase workspace together with some feature classes may have quite a bit of geoprocessing history contained in the metadata. (Thumbnails may also be a big contributor to the total metadata.) You can view the geoprocessing history for a feature class by ensuring that the metadata settings show the Geoprocessing History. Set the Metadata Style to anything other than “Item Description”, for example:

ArcCatalog > Customize > ArcCatalog Options > Metadata >

Metadata Style:  ISO 19139 Metadata Implementation Specification GML3.2

or

ArcGIS Pro > Options > Metadata >

Metadata Style:  ISO 19139 Metadata Implementation Specification GML3.2

Highlight the feature class (in a feature dataset if needs be).

In ArcCatalog click the Description Tab to see the metadata for the feature class.

In ArcMap right-click the feature class > Item Description > Description.

In ArcGIS Pro, in Catalog right-click on the feature class > View Metadata to see the metadata for the feature class.

Find the “Geoprocessing history” section which lists the geoprocessing tools which have been executed against the feature class.

For example: 

Geoprocessing history  ▼

►Process 

Process name

Date 2020-03-04 15:40:51

Tool location c:\program files\arcgis\desktop10.8\ArcToolbox\Toolboxes\Data Management Tools.tbx\CreateFeatureclass

Command issued

CreateFeatureclass “Database …

Geoprocessing metadata is logged by default.

In ArcCatalog or ArcMap logging behaviour can be disabled by unchecking the logging option found in the Geoprocessing > Geoprocessing Options dialog box.

In ArcGIS Pro logging behaviour can be disabled by unchecking the “Write geoprocessing operations to dataset metadata” option in Options > Geoprocessing.  

In a Python script, logging of geoprocessing history can be disabled using the SetLogHistory function.

#  Disable logging geoprocessing history

Arcpy.SetLogHistory(False)

How To Remove Geoprocessing History

If unneeded, all metadata can be removed from a feature class by:

Method 1:

Remove Metadata Geoprocessing History

Method 2:

(For use in ArcCatalog or ArcMap. Equivalent functionality will be availability in a future release of ArcGIS Pro.)

Step 1

Use the XSLT Transformation geoprocessing tool to generate .xml from the database. This strips all the geoprocessing history.

– Input ‘Source Metadata’ = Database connection feature class.

– Input ‘Input XSLT’ = Esri tool located in “C:\Program Files (x86)\ArcGIS\Desktop10.x\Metadata\Stylesheets\gpTools\remove geoprocessing history.xslt”.

– Input ‘Output File’ = Give it a location to save the .xml the tool is generating. (Remember this location.)

– Ensure that .xml is the extension for the Output File.

Step 2

Use the Metadata Importer geoprocessing tool to import the .xml with the cleared geoprocessing history into the database

– Input ‘Source Metadata’ = The .xml that was generated from the XSLT Transformation tool.

– Input ‘Target Metadata’ = Database connection feature class.

Documentation on these tools:

XSLT Transformation

Metadata Importer

Method 3:   

(For use in ArcCatalog or ArcMap. Equivalent functionality is not available in ArcGIS Pro.)

Use a newly created feature class as input to the Metadata Importer tool

ArcCatalog or Catalog> System Toolboxes > Conversion Tools > Metadata > Metadata Importer

and specify the feature class which needs to have the metadata size reduced.

Method 4:

Reduce the geoprocessing history using the following Python script.

How To: Delete geoprocessing history from a geodatabase

References

How to remove geoprocessing history in ArcGIS 10.2.2 for Desktop

SetLogHistory

Viewing all 274 articles
Browse latest View live