Re-apply changes to replace cuda_headers by cuda directory (#5891)

diff --git a/third_party/cuda_headers/LICENSE b/third_party/cuda/LICENSE
similarity index 100%
rename from third_party/cuda_headers/LICENSE
rename to third_party/cuda/LICENSE
diff --git a/third_party/cuda/README.txt b/third_party/cuda/README.txt
new file mode 100644
index 0000000..be1490c
--- /dev/null
+++ b/third_party/cuda/README.txt
@@ -0,0 +1,3 @@
+This folder contains a subset of CUDA SDK headers needed to build IREE.
+It also contains libdevice.10.bc llvm moddule used to import __nv* function
+during cuda kernel compilation.
\ No newline at end of file
diff --git a/third_party/cuda/UPDATING.md b/third_party/cuda/UPDATING.md
new file mode 100644
index 0000000..39f9331
--- /dev/null
+++ b/third_party/cuda/UPDATING.md
@@ -0,0 +1,13 @@
+Those headers come from CUDA SDK.
+
+To update, install CUDA SDK locally:
+```
+sudo apt-get install cuda
+```
+
+Copy cuda.h, version.txt and libdevice.10.bc:
+```
+cp /usr/local/cuda/include/cuda.h ./include/
+cp /usr/local/cuda/version.txt  .
+cp /usr/local/cuda/nvvm/libdevice/libdevice.10.bc ./nvvm/libdevice/
+```
diff --git a/third_party/cuda_headers/cuda.h b/third_party/cuda/include/cuda.h
similarity index 100%
rename from third_party/cuda_headers/cuda.h
rename to third_party/cuda/include/cuda.h
diff --git a/third_party/cuda/nvvm/libdevice/libdevice.10.bc b/third_party/cuda/nvvm/libdevice/libdevice.10.bc
new file mode 100644
index 0000000..897c8c9
--- /dev/null
+++ b/third_party/cuda/nvvm/libdevice/libdevice.10.bc
Binary files differ
diff --git a/third_party/cuda_headers/version.txt b/third_party/cuda/version.txt
similarity index 100%
rename from third_party/cuda_headers/version.txt
rename to third_party/cuda/version.txt
diff --git a/third_party/cuda_headers/README.txt b/third_party/cuda_headers/README.txt
deleted file mode 100644
index b437210..0000000
--- a/third_party/cuda_headers/README.txt
+++ /dev/null
@@ -1 +0,0 @@
-This folder contains a subset of CUDA SDK headers needed to build IREE.
\ No newline at end of file
diff --git a/third_party/cuda_headers/UPDATING.md b/third_party/cuda_headers/UPDATING.md
deleted file mode 100644
index 4f0382e..0000000
--- a/third_party/cuda_headers/UPDATING.md
+++ /dev/null
@@ -1,12 +0,0 @@
-Those headers come from CUDA SDK.
-
-To update, install CUDA SDK locally:
-```
-sudo apt-get install cuda
-```
-
-Copy cuda.h and version.txt:
-```
-cp /usr/local/cuda/include/cuda.h .
-cp /usr/local/cuda/version.txt  .
-```