Hi:
I want to install pydaal. When it compile the source code _data_management__db.cpp and say from
#include <data_management/data_source/mysql_feature_manager.h> it can not find <sql.h> in daal/include/data_management/data_source/mysql_feature_manager.h
Of course, because I do not install mysql in my computer, so there is no sql.h in my computer. Actually, I use postgresql as my database, so mysql_feature_manager is completely useless to me. I want to ask how to install pydaal without mysql
I keep getting segmentation faults within mkl_dcoomv() function from MKL invoked in a native mode program on Xeon Phi (KNC). The code works well on the host (Haswell) as well as with the CSR strorage format (mkl_dcsrmv()) instead of COO. So, the problem happens only with the combination of COO an MIC.
In a debugger, I got the following error message:
Catchpoint -1 (signal SIGSEGV), 0x00007ffff514cc8a in mkl_spblas_lp64_dcoo0ng__c__mvout_mic () from /apps/all/imkl/2017.0.098-iimpi-2017.00-GCC-5.4.0-2.26/mkl/lib/mic/libmkl_intel_thread.so
The MKL and compiler versions are both 2017.
The code can be found here.
Any hints?
I have a fortran code using MPI and calling FFTW3. It can be successfully compiled by the command mpiifort. But when I try to use mpif90, it gives errors like:
fftwtest_fwd.f90:(.text+0x2a6): undefined reference to `fftw_mpi_init'
fftwtest_fwd.f90:(.text+0x2e7): undefined reference to `fftw_mpi_local_size_2d_f03'
fftwtest_fwd.f90:(.text+0x2f7): undefined reference to `fftw_alloc_complex'
fftwtest_fwd.f90:(.text+0x46e): undefined reference to `fftw_mpi_plan_dft_2d_f03'
fftwtest_fwd.f90:(.text+0x630): undefined reference to `fftw_mpi_execute_dft'
fftwtest_fwd.f90:(.text+0x937): undefined reference to `fftw_destroy_plan'
fftwtest_fwd.f90:(.text+0x93c): undefined reference to `fftw_mpi_cleanup'
fftwtest_fwd.f90:(.text+0x948): undefined reference to `fftw_free'
I compile the code using my laptop, the parallel studio xe 2017 has been installed.
However, when I use mpiffort and mpif90 compile the same code on a server of my organization, everything is good. Could someone give me directions? Thank you very much.
Intel® DAAL 2017 Update 2 was just released. Here are What's New in this release:
This document provides a general summary of new features and important notes about the Intel® Data Analytics Acceleration library (Intel® DAAL) software product. Please see the following links to the online resources and documents for the latest information regarding Intel DAAL:
· Intel® DAAL 2018 Installation Guide
· Intel® DAAL 2018 System Requirements
Links to documentation, help, and code samples can be found on the main Intel DAAL product page. For technical support visit the Intel DAAL technical support forum and review the articles in the Intel DAAL knowledge base.
Please register your product using your preferred email address. This helps Intel recognize you as a valued customer in the support forum and insures that you will be notified of product updates. You can read Intel's Online Privacy Notice Summary if you have any questions regarding the use of your email address for software product registration.
Intel DAAL can be installed as a part of the following suite:
Intel DAAL consists of one package for both IA-32 and Intel® 64 architectures.
If you did not register your Intel software product during installation, please do so now at the Intel® Software Development Products Registration Center. Registration entitles you to free technical support, product updates, and upgrades for the duration of the support term.
For information about how to find Technical Support, Product Updates, User Forums, FAQs, tips and tricks, and other support information, please visit https://software.intel.com/en-us/intel-daal-support.
Note: If your distributor provides technical support for this product, please contact them for support rather than Intel.
INFORMATION IN THIS DOCUMENT IS PROVIDED IN CONNECTION WITH INTEL PRODUCTS. NO LICENSE, EXPRESS OR IMPLIED, BY ESTOPPEL OR OTHERWISE, TO ANY INTELLECTUAL PROPERTY RIGHTS IS GRANTED BY THIS DOCUMENT. EXCEPT AS PROVIDED IN INTEL'S TERMS AND CONDITIONS OF SALE FOR SUCH PRODUCTS, INTEL ASSUMES NO LIABILITY WHATSOEVER AND INTEL DISCLAIMS ANY EXPRESS OR IMPLIED WARRANTY, RELATING TO SALE AND/OR USE OF INTEL PRODUCTS INCLUDING LIABILITY OR WARRANTIES RELATING TO FITNESS FOR A PARTICULAR PURPOSE, MERCHANTABILITY, OR INFRINGEMENT OF ANY PATENT, COPYRIGHT OR OTHER INTELLECTUAL PROPERTY RIGHT.
A "Mission Critical Application" is any application in which failure of the Intel Product could result, directly or indirectly, in personal injury or death. SHOULD YOU PURCHASE OR USE INTEL'S PRODUCTS FOR ANY SUCH MISSION CRITICAL APPLICATION, YOU SHALL INDEMNIFY AND HOLD INTEL AND ITS SUBSIDIARIES, SUBCONTRACTORS AND AFFILIATES, AND THE DIRECTORS, OFFICERS, AND EMPLOYEES OF EACH, HARMLESS AGAINST ALL CLAIMS COSTS, DAMAGES, AND EXPENSES AND REASONABLE ATTORNEYS' FEES ARISING OUT OF, DIRECTLY OR INDIRECTLY, ANY CLAIM OF PRODUCT LIABILITY, PERSONAL INJURY, OR DEATH ARISING IN ANY WAY OUT OF SUCH MISSION CRITICAL APPLICATION, WHETHER OR NOT INTEL OR ITS SUBCONTRACTOR WAS NEGLIGENT IN THE DESIGN, MANUFACTURE, OR WARNING OF THE INTEL PRODUCT OR ANY OF ITS PARTS.
Intel may make changes to specifications and product descriptions at any time, without notice. Designers must not rely on the absence or characteristics of any features or instructions marked "reserved" or "undefined." Intel reserves these for future definition and shall have no responsibility whatsoever for conflicts or incompatibilities arising from future changes to them. The information here is subject to change without notice. Do not finalize a design with this information.
The products described in this document may contain design defects or errors known as errata which may cause the product to deviate from published specifications. Current characterized errata are available on request.
Contact your local Intel sales office or your distributor to obtain the latest specifications and before placing your product order.
Copies of documents which have an order number and are referenced in this document, or other Intel literature, may be obtained by calling 1-800-548-4725, or by visiting Intel's Web Site.
Intel processor numbers are not a measure of performance. Processor numbers differentiate features within each processor family, not across different processor families. See http://www.intel.com/products/processor_number for details.
BlueMoon, BunnyPeople, Celeron, Celeron Inside, Centrino, Centrino Inside, Cilk, Core Inside, E-GOLD, Flexpipe, i960, Intel, the Intel logo, Intel AppUp, Intel Atom, Intel Atom Inside, Intel Core, Intel Inside, Intel Insider, the Intel Inside logo, Intel NetBurst, Intel NetMerge, Intel NetStructure, Intel SingleDriver, Intel SpeedStep, Intel Sponsors of Tomorrow., the Intel Sponsors of Tomorrow. logo, Intel StrataFlash, Intel vPro, Intel Xeon Phi, Intel XScale, InTru, the InTru logo, the InTru Inside logo, InTru soundmark, Itanium, Itanium Inside, MCS, MMX, Moblin, Pentium, Pentium Inside, Puma, skoool, the skoool logo, SMARTi, Sound Mark, Stay With It, The Creators Project, The Journey Inside, Thunderbolt, Ultrabook, vPro Inside, VTune, Xeon, Xeon Inside, X-GOLD, XMM, X-PMU and XPOSYS are trademarks of Intel Corporation in the U.S. and/or other countries.Intel, and the Intel logo are trademarks of Intel Corporation in the U.S. and/or other countries.
*Other names and brands may be claimed as the property of others.
Java is a registered trademark of Oracle and/or its affiliates.
© Copyright 2017, Intel Corporation
Intel's compilers may or may not optimize to the same degree for non-Intel microprocessors for optimizations that are not unique to Intel microprocessors. These optimizations include SSE2, SSE3, and SSSE3 instruction sets and other optimizations. Intel does not guarantee the availability, functionality, or effectiveness of any optimization on microprocessors not manufactured by Intel. Microprocessor-dependent optimizations in this product are intended for use with Intel microprocessors. Certain optimizations not specific to Intel microarchitecture are reserved for Intel microprocessors. Please refer to the applicable product User and Reference Guides for more information regarding the specific instruction sets covered by this notice. Notice revision #20110804 |
Please see the following links to the online resources and documents for the latest information regarding Intel DAAL:
· Intel® DAAL 2018 Release Notes
· Intel® DAAL 2018 Installation Guide
· Intel® DAAL 2018 System Requirements
These instructions assume a standalone installation of Intel® Data Analytics Acceleration Library (Intel® DAAL). If your copy of Intel® DAAL was included as part of one of our "suite products" (e.g., Intel® Parallel Studio XE) your installation procedure may be different than that described below; in which case, please refer to the readme and installation guides for your "suite product" for specific installation details.
Before installing Intel® DAAL, check the Product Downloads section of Intel® Registration Center to see if a newer version of the library is available. The version listed in your electronic download license letter may not be the most current version available.
The installation of the product requires a valid license file or serial number. If you are evaluating the product, you can also choose the "Evaluate this product (no serial number required)" option during installation.
If you have a previous version of Intel® DAAL installed you do not need to uninstall it before installing a new version. If you choose to uninstall the older version, you may do so at any time.
Note: Installation on 32-bit hosts is no longer supported. However, the 32-bit library continues to exist, and can be used on 64-bit hosts.
You can install multiple versions of Intel® DAAL and any combination of 32-bit and 64-bit variations of the library on your development system.
These instructions assume you to have an Internet connection. The installation program will automatically download a license key to your system. If you do not have an internet connection, see the manual installation instructions below.
The default electronic installation package for Intel® DAAL for Windows now consists of a smaller installation package that dynamically downloads and then installs packages selected to be installed. This requires a working internet connection and potentially a proxy setting if you are behind an internet proxy. Full packages are provided alongside where you download this online install package if a working internet connection is not available.
Silent installation enables you to install Intel® DAAL on a single Windows* machine in a batch mode, without input prompts. Use this option if you need to install on multiple similarly configured machines, such as cluster nodes.
To invoke silent installation:
If no command is specified, the installation proceeds in the Setup Wizard mode. If a command is specified, the installation proceeds in the non-interactive (silent) mode.
The table below lists possible values of and the corresponding arguments.
Command | Required Arguments | Optional Arguments | Action |
|---|---|---|---|
| output=<file>, eula={accept|reject} | installdir=<installdir>, license=<license>, sn=<s/n>, log=<log file> | Installs the product as specified by the arguments. Use the output argument to define the file where the output will be redirected. This file contains all installer's messages that you may need: general communication, warning, and error messages. Explicitly indicate by eula=accept that you accept the End-user License Agreement. Use the license argument to specify a file or folder with the license to be used to activate the product. If a folder is specified, the installation program searches for *.lic files in the specified folder. You can specify multiple files/folders by supplying this argument several times or by concatenating path strings with the ";" separator. Use the sn argument to choose activation of the product through a serial number. This activation method requires Internet connection. Do not use the sn and license arguments together because they specify alternative activation methods. If you omit both arguments, the installer only checks whether the product is already activated. Use the log argument to specify the location for a log file. This file is used only for debugging. Support Engineers may request this file if your installation fails. | |
remove | output=<file> | log=<log file> | Removes the product. See the description of the install command for details of the output and log arguments. |
repair | output=<file> | log=<log file> | Repairs the existing product installation. See the description of the install command for details of the output and log arguments. |
For example, the command line
setup.exe install -output=C:\log.txt -eula=accept
launches silent installation that prints output messages to the C:\log.txt file.
If you have an evaluation license and decide to upgrade to a commercial license, you must complete the following steps after obtaining the commercial serial number:
To uninstall Intel® DAAL, select Add or Remove Programs from the Control Panel and locate the version of Intel® DAAL you wish to uninstall.
Note: Uninstalling Intel® DAAL does not delete the corresponding license file.
You can install multiple versions of Intel® DAAL and any combination of 32-bit and 64-bit variations of the library on your development system.
These instructions assume you to have an Internet connection. The installation program will automatically download a license key to your system. If you do not have an Internet connection, see the manual installation instructions below.
If on a Linux* system with GUI support, the installation will provide a GUI-based installation. If a GUI is not supported (for example if running from an ssh terminal), a command-line installation will be provided.
To install Intel® DAAL for Linux* OS in GUI mode, run shell script (install_GUI.sh).
If a GUI is not supported (for example, if running from an ssh terminal), a command-line installation will be provided.
To run the silent install, follow these steps:
Tip: You can run install interactively and record all the options into custom configuration file using the following command.
>./install.sh --duplicate "./my_silent_config.cfg"
After this you can install the package on other machines with the same installation options using
>./install.sh --silent "./my_silent_config.cfg"
If you have an evaluation license and decide to upgrade to a commercial license, you must complete the following steps after obtaining the commercial serial number:
The default electronic installation package for Intel® DAAL for Linux consists of a smaller installation package that dynamically downloads and then installs packages selected to be installed. This requires a working internet connection and potentially a proxy setting if you are behind an internet proxy. Full packages are provided alongside where you download this online install package if a working internet connection is not available.
If the system where Intel® DAAL will be installed disconnected from internet, product may be installed in offline mode.
To install product offline user must provide to installer full path to license file.
License file (.lic file) is included as an attachment to email which sends after purchasing and registration product on IRC. User may request to resend .lic file from IRC. To achieve this go to "My Intel Products" page, select needed update for Intel® DAAL from "Download Latest Update" column. When page with information about selected product update will be opened, click on "Manage" reference in "Licenses" column. When "Manage License" page will be opened, press button "Resend license file to my email".
If you installed as root, you will need to log in as root.
To uninstall Intel® DAAL run the uninstall script: <DAAL-install-dir>/uninstall.sh.
Alternatively, you may use GUI mode for uninstall Intel® DAAL for Linux* OS. First, run shell script install_GUI.sh, then select Remove option from menu and press "next" button.
If you installed in the default directory, use:
> /opt/intel/compilers_and_libraries_2017/linux/daal
Uninstalling Intel® DAAL will not delete your license file(s).
There are several different product suites available, for example, Intel® Data Analytics Acceleration Library for macOS*, Intel® Parallel Studio XE Composer Edition for C++ macOS*, each including Intel DAAL as one of components. Please read the download web page carefully to determine which product is appropriate for you.
If you will be using Xcode*, please make sure that a supported version of Xcode is installed. If you install a new version of Xcode in the future, you must reinstall the Intel DAAL afterwards.
The installation of the product requires a valid license file or serial number. If you are evaluating the product, you can also choose the “Evaluate this product (no serial number required)” option during installation.
These instructions assume you to have an Internet connection. The installation program will automatically download a license key to your system. If you do not have an Internet connection, see the manual installation instructions below.
Use serial number
If you do have an Internet connection, skip this step and proceed to the next numbered step (below).
Evaluate this product (no serial number required or if you want to activate at a later time).
Alternative Activation
If you do not have an Internet connection, choose Alternative Activation and click Next; there will be two options to choose from:
Silent installation enables you to install Intel DAAL on a single macOS* machine in a batch mode without input prompts. Use this option if you need to install on multiple similarly configured machines, such as cluster nodes. For information on automated or “silent” install capability, please seehttp://intel.ly/1gcW0Bl
Support of Non-Interactive Custom Installation
Intel DAAL can save user install choices during an ‘interactive’ install in a configuration file that can then be used for silent installs. This configuration file is created when the following option is used from the command line install:
If you have an evaluation license and decide to upgrade to a commercial license, you must complete the following steps after obtaining the commercial serial number:
It is not possible to remove the compiler while leaving any of the performance library components installed.
If you are not currently logged in as root you will be asked for the root password.
Uninstalling Intel® DAAL will not delete your license file(s).
Intel, and the Intel logo are trademarks of Intel Corporation in the U.S. and/or other countries.
*Other names and brands may be claimed as the property of others.
Java is a registered trademark of Oracle and/or its affiliates.
© Copyright 2017, Intel Corporation
Please see the following links to the online resources and documents for the latest information regarding Intel DAAL:
· Intel® DAAL 2018 Release Notes
· Intel® DAAL 2018 Installation Guide
· Intel® DAAL 2018 System Requirements
The Intel® DAAL supports the IA-32 and Intel® 64 architectures. For a complete explanation of these architecture names please read the following article:
Intel Architecture Platform Terminology for Development Tools.
The lists below pertain only to the system requirements necessary to support application development with Intel® DAAL. Please review your compiler (gcc*, Microsoft Visual Studio* or Intel® Compiler Pro) hardware and software system requirements, in the documentation provided with that product to determine the minimum development system requirements necessary to support your compiler product.
Note: Intel® DAAL is expected to work on many more Linux distributions as well. Let us know if you have trouble with the distribution you use.
Note: Intel® DAAL is expected to work on many more Hadoop* distributions as well. Let us know if you have trouble with the distribution you use.
Note: Intel® DAAL is expected to work on many more Spark* distributions as well. Let us know if you have trouble with the distribution you use.
A series of API changes are introduced into Intel® DAAL to improve usability, error handling, and consistency. These changes will start to take effective in Intel DAAL 2018 Beta. The changes discussed below are centered on the C++ API, but similar changes also apply to the Java API and the Python API.
| API | Before | After |
|---|---|---|
| Error handling |
|
|
| class Environment |
|
|
| Alternating Least Square initialization |
|
|
Alternating Least Square renamings |
|
|
| kNN algorithm |
|
|
| k-means initialization in distributed computing mode |
|
|
| K-means namings |
|
|
| Multi-class classfier Model |
|
|
| Neural Network training parameter |
|
|
| NumericTable |
|
|
| NumericTable |
| |
| HomogenNumericTable |
|
|
| AOS Numeric Table |
|
|
| SOA Numeric Table |
|
|
| Data Dictionary |
| |
| NumericTable |
|
|
| NumericTable |
|
|
| Tensor |
|
|
| class NumericTableIface |
|
|
| HomogenTensor |
|
|
| Algorithms and numeric tables |
|
|
| Multinomial Naïve Bayes algorithm |
|
|
| Linear regression algorithm |
|
|
| Ridge regression algorithm |
|
|
| Multi-class classifieralgorithm |
|
|
| Neural Networks Topology for training and prediction |
|
|
| Default data type for algorithms, numeric tables, and data sources |
class DAAL_EXPORT HomogenNumericTable : public NumericTable
class DataSourceTemplate : public DataSource |
DAAL_ALGORITHM_FP_TYPE is float by default
class DAAL_EXPORT HomogenNumericTable : public NumericTable DAAL_DATA_TYPE is float by default
class DataSourceTemplate : public DataSource DAAL_SUMMARY_STATISTICS_TYPE is float by default |
| Classes | Methods deprecated |
|---|---|
| Environment | freeInstance |
| Multi-class classifier Model | getTwoClassClassifierModels |
| NumericTable | setDictionary, resetDictionary, setNumberOfColumns, setNumberOfRows, allocateDataMemory, freeDataMemory |
| HomogenNumericTable | setArray |
| HomogenTensor | getSampleTensor |
| Classes | Before | After |
|---|---|---|
| All algorithmic classes | void compute( ) | Status compute( ) |
| All input argument classes | void check( ... ) | Status check( ... ) |
| All result and partial result classes | void check( ... ) void allocate( .. ) | Status check( ... ) Status allocate( ... ) |
| AOSNumericTable | void setFeature( size_t idx, size_t offset ) | vid setFeature( size_t idx, size_t offset, data_feature_utils::FeatureType featureType = data_feature_utils::DAAL_CONTINUOUS, size_t categoryNumber=0 ) |
| SOANumericTable | SOANumericTable( size_t nColumns = 0, size_t nRows = 0 ) | SOANumericTable( size_t nColumns = 0, size_t nRows = 0, DictionaryIface::FeaturesEqual featuresEqual = DictionaryIface::notEqual ) |
| NumericTable | The return value of getNumberOfCategories( size_t feature_idx ) was either (size_t) - 1 when all attributes are continuous, or 1 otherwise. | The return value of this method is now extended to support different types of attributes. |
| Classes | New methods |
|---|---|
| NumericTable | void resize( size_t nrows ) - To modify the number of feature vectors in a table. |
| DataDictionary | void setAllFeatures( ... ) - To configure the attributes of the datasets to be the same type. |
Hi,
I know about the OOC functionality, but if I just want to use the in-core option (iparm(60) = 0), how can I make sure pardiso uses virtual memory (windows 7)? In a large solve with 6 million unknowns, I get the error code -2. After phase 1 I calculate the memory requirement from pardiso as around 30gb, which is more than my available ram, but much less than my available virtual memory.
Related to this is the following question: what is the exact criterion which causes error code -2?
Best,
Jens
First, I'd like to congratulate Intel on the awesome initiatives to (1) make MKL freely available through the Community Licensing, (2) develop the super fast Intel Distribution for Python and (3) make it available through Continuum's conda.
There's only one thing that is really missing now: to provide a mkl-devel conda package so that we are able to build other packages that depend on MKL using conda-build locally or on the conda-forge infrastructure.
Continuum already have an internal private mkl-devel package which they use to build their version of numpy and other packages, but they are not able to publish it due to licensing restrictions (despite MKL having a free version already), please see:
https://github.com/ContinuumIO/anaconda-recipes/issues/50
and:
https://github.com/ContinuumIO/anaconda-issues/issues/888
Could Intel make this package available, or provide a way to make it available?
Thanks!
